00000001:02000400:1.0F:1782756049.528756:0:2964:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg425-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1782756062.070770:0:3191:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local 00000001:01000000:0.0:1782756063.353989:0:3235:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1023 MB/s 00000001:01000000:1.0:1782756063.603557:0:3235:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1003 MB/s 00000001:01000000:0.0:1782756063.853165:0:3235:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 6315 MB/s 00000020:02000000:1.0:1782756064.402445:0:3283:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_83_g2cb683b 00000400:02000000:0.0:1782756064.975628:0:3298:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.204.125@tcp [8/256/0/180] 00008000:02000000:2.0F:1782756068.014789:0:3448:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1782756106.096048:0:5246:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1782756112.795600:0:5784:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782756112.795608:0:5784:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1782756112.795745:0:5784:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000aefb740c 00000080:02000400:2.0:1782756112.795756:0:5784:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1782756112.806815:0:5784:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1782756112.806833:0:5784:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1782756112.806888:0:5784:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000ca7ff705) 00000020:00000080:2.0:1782756112.806916:0:5784:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0F:1782756112.834412:0:5784:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1782756112.834798:0:5784:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1782756112.860557:0:5784:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1782756112.860595:0:5784:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1782756112.860616:0:5784:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1782756112.860668:0:5784:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1782756112.860692:0:5784:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1782756112.861039:0:5784:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1782756112.861046:0:5784:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782756112.861056:0:5784:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5e4fb0a8aa1988b1 00000020:01000004:3.0:1782756112.861063:0:5784:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1782756112.861068:0:5784:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1782756112.861313:0:5784:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000aefb740c from MGS 00000020:01000004:3.0:1782756112.861319:0:5784:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1782756112.861492:0:5784:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000817dfd9d) 00000020:00000080:3.0:1782756112.861506:0:5784:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1782756112.861614:0:5784:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000aefb740c from MGS, refs=2 00080000:01000000:3.0:1782756112.861620:0:5784:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1782756112.861625:0:5784:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5e4fb0a8aa1988bf 00000100:00100000:3.0:1782756112.861729:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1782756112.861849:0:5784:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1782756112.861855:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1782756112.862531:0:5784:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1782756112.862537:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1782756112.863359:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782756112.863506:0:5784:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1782756112.863511:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1782756112.863984:0:5784:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1782756112.863990:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1782756112.864545:0:5784:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1782756112.864551:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1782756112.865277:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756112.865281:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756112.865283:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756112.865610:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756112.865613:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756112.865614:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756112.866401:0:5784:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1782756112.871457:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1782756113.115137:0:5784:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4711 MB/s 00000001:01000000:3.0:1782756113.365125:0:5784:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 7207 MB/s 00000001:01000000:3.0:1782756113.615143:0:5784:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 643 MB/s 00000001:01000000:2.0:1782756113.865166:0:5784:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1003 MB/s 00010000:00010000:1.0:1782756113.870711:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1782756113.874892:0:5784:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1782756113.891610:0:5784:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1782756113.891627:0:5784:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1782756113.891629:0:5784:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1782756113.892341:0:5794:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1782756113.895485:0:5784:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1782756113.895553:0:5784:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1782756113.895845:0:5784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1782756113.895877:0:5784:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1782756113.897610:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782756113.897769:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1782756113.897776:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1782756113.904864:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1782756113.904881:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1782756113.905489:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1782756113.905496:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1782756113.906698:0:5784:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1782756113.906728:0:5784:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.204.125@tcp' 00000020:01000004:1.0:1782756113.906730:0:5784:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1782756113.906774:0:5784:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.204.125@tcp (typ=mgc) 00000020:00000080:1.0:1782756113.906796:0:5784:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.125@tcp (000000002d2790e8) 00000020:00000080:1.0:1782756113.906811:0:5784:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1782756113.906920:0:5784:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d3bbca08@MGC192.168.204.125@tcp: add connection 192.168.204.125@tcp at head 00010000:00010000:1.0:1782756113.907059:0:5784:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.125@tcp-0 is initialized 00000040:01000000:1.0:1782756113.907064:0:5784:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.125@tcp ctxt 1 is initialized 00000100:00080000:2.0:1782756113.907506:0:5799:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1782756113.908854:0:5800:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1782756113.908927:0:5784:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.125@tcp (uuid 0daec403-69b6-4c98-a0ea-f519ca0a480f) 00000020:00000080:2.0:1782756113.908945:0:5784:0:(genops.c:1406:class_connect()) connect: client 0daec403-69b6-4c98-a0ea-f519ca0a480f, cookie 0x5e4fb0a8aa1988cd 00000100:00080000:2.0:1782756113.908955:0:5784:0:(import.c:512:import_select_connection()) MGC192.168.204.125@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782756113.908960:0:5784:0:(import.c:626:import_select_connection()) MGC192.168.204.125@tcp: import 00000000d3bbca08 using connection 192.168.204.125@tcp/0@lo 00000100:00100000:2.0:1782756113.908997:0:5784:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002cc3b8b5 x1869355222564992/t0(0) o250->MGC192.168.204.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782756113.909109:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002cc3b8b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0daec403-69b6-4c98-a0ea-f519ca0a480f:3313:1869355222564992:0@lo:250: 00000100:00080000:2.0:1782756113.909472:0:5784:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 0daec403-69b6-4c98-a0ea-f519ca0a480f->MGS 00000020:01000004:2.0:1782756113.909491:0:5784:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1782756113.909504:0:5784:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1782756113.909516:0:5784:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000009f7a393a) 00000020:00000080:2.0:1782756113.909527:0:5784:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1782756113.910655:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756113.912534:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222564992 00000100:00100000:3.0:1782756113.912548:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222564992 00000100:00100000:3.0:1782756113.912593:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782756113.912600:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0269b9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3313:x1869355222564992:12345-0@lo:250: 00010000:00080000:3.0:1782756113.912625:0:5796:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 0daec403-69b6-4c98-a0ea-f519ca0a480f@0@lo t0 exp 0000000000000000 cur 155 last 0 00000020:00000080:3.0:1782756113.912650:0:5796:0:(genops.c:1406:class_connect()) connect: client 0daec403-69b6-4c98-a0ea-f519ca0a480f, cookie 0x5e4fb0a8aa1988db 00000100:00080000:3.0:1782756113.912780:0:5796:0:(import.c:65:import_set_state_nolock()) 00000000b26277a5 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782756113.912852:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0269b9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+5:3313:x1869355222564992:12345-0@lo:250: Request processed in 251us (2202us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756113.912861:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782756113.913015:0:3313:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.204.125@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1782756113.913024:0:3313:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.204.125@tcp: connect to target with instance 0 00000100:00080000:0.0:1782756113.913031:0:3313:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.204.125@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1782756113.913035:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1782756113.913038:0:3313:0:(import.c:65:import_set_state_nolock()) 00000000d3bbca08 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1782756113.913041:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1782756113.913053:0:3313:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1782756113.913058:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002cc3b8b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0daec403-69b6-4c98-a0ea-f519ca0a480f:3313:1869355222564992:0@lo:250: 00000100:00100000:2.0:1782756113.923895:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782756113.924472:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1782756113.924479:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1782756113.925407:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1782756113.925414:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1782756113.927688:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1782756113.927700:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1782756113.929626:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782756113.929905:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1782756113.929913:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1782756113.931703:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1782756113.931783:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1782756113.969771:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782756113.970003:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1782756113.970011:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1782756113.977192:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1782756113.977215:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1782756113.978244:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782756113.979205:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1782756113.979214:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1782756113.980195:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1782756113.980221:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1782756113.980907:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782756113.981047:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1782756113.981052:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1782756113.981850:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1782756113.981858:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1782756113.983380:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782756113.983542:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1782756113.983548:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1782756113.984472:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1782756113.984481:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1782756114.005497:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782756114.005686:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1782756114.005756:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1782756114.008981:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1782756114.008996:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1782756114.009748:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1782756114.009774:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1782756114.011990:0:5784:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1782756114.012017:0:5784:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1782756114.012023:0:5784:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.125@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1782756114.012350:0:5784:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.125@tcp ctxt 0 is initialized 00000020:01000004:0.0:1782756114.012385:0:5784:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.125@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1782756114.012390:0:5784:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1782756114.012392:0:5784:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782756114.012393:0:5784:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782756114.012394:0:5784:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782756114.012395:0:5784:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782756114.012397:0:5784:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782756114.012398:0:5784:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782756114.012399:0:5784:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782756114.012400:0:5784:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782756114.012402:0:5784:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782756114.012403:0:5784:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782756114.012405:0:5784:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782756114.012407:0:5784:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1782756114.012409:0:5784:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782756114.012410:0:5784:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782756114.012411:0:5784:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782756114.012412:0:5784:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782756114.012413:0:5784:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782756114.012414:0:5784:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782756114.012415:0:5784:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782756114.012416:0:5784:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782756114.012417:0:5784:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782756114.012418:0:5784:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782756114.012419:0:5784:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782756114.012420:0:5784:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782756114.012460:0:5784:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1782756114.012482:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a5354c9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222565120:0@lo:253: 00000100:00100000:0.0:1782756114.012554:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756114.012625:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set 000000006de2694d going to sleep for 11 seconds 00000100:00100000:2.0:1782756114.012669:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222565120 00000100:00100000:2.0:1782756114.012674:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222565120 00000100:00100000:2.0:1782756114.012881:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782756114.012890:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026b56635 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+5:5784:x1869355222565120:12345-0@lo:253: 20000000:01000000:2.0:1782756114.012943:0:5798:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1782756114.012946:0:5798:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1782756114.013553:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1782756114.013600:0:5798:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1782756114.013997:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782756114.015341:0:5820:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1782756114.015689:0:5798:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1782756114.015693:0:5798:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1782756114.015700:0:5798:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1782756114.015703:0:5798:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1782756114.015720:0:5798:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1782756114.016377:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782756114.016719:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1782756114.016734:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1782756114.016785:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1782756114.016910:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1782756114.016949:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1782756114.017041:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1782756114.017047:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1782756114.017228:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1782756114.017237:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1782756114.017272:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1782756114.017280:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1782756114.017312:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1782756114.017362:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1782756114.017407:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1782756114.017413:0:5798:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1782756114.017426:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782756114.017634:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1782756114.017644:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1782756114.017680:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1782756114.017912:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1782756114.017977:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1782756114.017990:0:5798:0:(mgs_llog.c:3120:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1782756114.018071:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1782756114.018217:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1782756114.018270:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1782756114.018308:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1782756114.018343:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1782756114.018355:0:5798:0:(mgs_llog.c:3085:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1782756114.018439:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1782756114.018449:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1782756114.018479:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1782756114.018514:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1782756114.019932:0:5798:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1782756114.020017:0:5798:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1782756114.020025:0:5798:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1782756114.020529:0:5821:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1782756114.020766:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1782756114.020858:0:5798:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.125@tcp for mdt 20000000:01000000:2.0:1782756114.020861:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.125@tcp (null) (null) (null) 00000040:00080000:2.0:1782756114.020912:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1782756114.020922:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1782756114.020968:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1782756114.020975:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.125@tcp (null) (null) 00000040:00080000:2.0:1782756114.021039:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1782756114.021051:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1782756114.021308:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1782756114.021369:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1782756114.021475:0:5798:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1782756114.021479:0:5798:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1782756114.021482:0:5798:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1782756114.021493:0:5798:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1782756114.021495:0:5798:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1782756114.021525:0:5798:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1782756114.021526:0:5798:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1782756114.022058:0:5822:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1782756114.022403:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1782756114.022456:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1782756114.022519:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1782756114.022531:0:5798:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1782756114.022533:0:5798:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1782756114.023030:0:5823:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1782756114.023351:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1782756114.023390:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1782756114.023682:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1782756114.023706:0:5798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782756114.023709:0:5798:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1782756114.023713:0:5798:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1782756114.023731:0:5798:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1782756114.023736:0:5798:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1782756114.023741:0:5798:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1782756114.024648:0:5824:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1782756114.024951:0:5798:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1782756114.041163:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1782756114.041242:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1782756114.041332:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1782756114.041358:0:5798:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1782756114.041380:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009906f227/0x5e4fb0a8aa1988e2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756114.041396:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009906f227/0x5e4fb0a8aa1988e2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756114.041423:0:5798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009906f227/0x5e4fb0a8aa1988e2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756114.041430:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009906f227/0x5e4fb0a8aa1988e2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756114.041436:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009906f227/0x5e4fb0a8aa1988e2 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756114.041443:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009906f227/0x5e4fb0a8aa1988e2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756114.041449:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009906f227 already unused, calling callback (000000002fba626f) 00010000:00010000:3.0:1782756114.041452:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009906f227/0x5e4fb0a8aa1988e2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756114.041459:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009906f227/0x5e4fb0a8aa1988e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756114.041470:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009906f227/0x5e4fb0a8aa1988e2 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756114.041476:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009906f227/0x5e4fb0a8aa1988e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756114.041482:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009906f227/0x5e4fb0a8aa1988e2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1782756114.041501:0:5798:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1782756114.221230:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a5354c9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222565120:0@lo:253: 10000000:01000000:0.0:1782756114.221257:0:5784:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1782756114.221261:0:5784:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782756114.221263:0:5784:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782756114.221264:0:5784:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782756114.221265:0:5784:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1782756114.221267:0:5784:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782756114.221268:0:5784:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782756114.221269:0:5784:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782756114.221270:0:5784:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782756114.221272:0:5784:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1782756114.221273:0:5784:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782756114.221274:0:5784:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1782756114.221292:0:5784:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000aefb740c from lustre-MDT0000 10000000:01000000:0.0:1782756114.221316:0:5784:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1782756114.221319:0:5784:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1782756114.221323:0:5784:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9d3c4aba3380 10000000:01000000:0.0:1782756114.221327:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782756114.221335:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9d3c4aba3380 from 1 10000000:01000000:0.0:1782756114.221337:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782756114.221376:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: 000000005f2feb9e/0x5e4fb0a8aa1988e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756114.221388:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: 000000005f2feb9e/0x5e4fb0a8aa1988e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756114.221396:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: 000000005f2feb9e/0x5e4fb0a8aa1988e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756114.221414:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a5354c9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222565248:0@lo:101: 00000100:00100000:0.0:1782756114.221502:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756114.221558:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set 000000009091937d going to sleep for 11 seconds 00000100:00100000:3.0:1782756114.221649:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222565248 00000100:00100000:3.0:1782756114.221656:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222565248 00000100:00100000:3.0:1782756114.221709:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782756114.221718:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0df296e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+6:5784:x1869355222565248:12345-0@lo:101: 00010000:00010000:3.0:1782756114.221732:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756114.221744:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009906f227/0x5e4fb0a8aa1988f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa1988e9 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756114.221767:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009906f227/0x5e4fb0a8aa1988f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa1988e9 expref: 7 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756114.221776:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009906f227/0x5e4fb0a8aa1988f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa1988e9 expref: 7 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756114.221785:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009906f227, rc 0) 00000100:00100000:3.0:1782756114.221874:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0df296e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+7:5784:x1869355222565248:12345-0@lo:101: Request processed in 158us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756114.221881:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782756114.221983:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026b56635 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+6:5784:x1869355222565120:12345-0@lo:253: Request processed in 209094us (209430us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756114.221992:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782756114.222147:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a5354c9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222565248:0@lo:101: 00010000:00010000:1.0:1782756114.222161:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: 000000005f2feb9e/0x5e4fb0a8aa1988e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa1988f0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.222170:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: 000000005f2feb9e/0x5e4fb0a8aa1988e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa1988f0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756114.222257:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ea5c4c45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222565376:0@lo:501: 00000100:00100000:1.0:1782756114.222298:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756114.222369:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set 000000003d8e5e0d going to sleep for 11 seconds 00000100:00100000:3.0:1782756114.222409:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222565376 00000100:00100000:3.0:1782756114.222414:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222565376 00000100:00100000:3.0:1782756114.222490:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782756114.222498:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f3618c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+6:5784:x1869355222565376:12345-0@lo:501: 00000100:00100000:3.0:1782756114.222713:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f3618c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+6:5784:x1869355222565376:12345-0@lo:501: Request processed in 216us (414us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782756114.222720:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782756114.222783:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ea5c4c45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222565376:0@lo:501: 10000000:01000000:1.0:1782756114.222803:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1782756114.222825:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: 000000005f2feb9e/0x5e4fb0a8aa1988e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa1988f0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.222833:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: 000000005f2feb9e/0x5e4fb0a8aa1988e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa1988f0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756114.222840:0:5784:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d3c4505a800 10000000:01000000:1.0:1782756114.222844:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1782756114.222848:0:5784:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9d3c4505a800 10000000:01000000:1.0:1782756114.222850:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1782756114.222852:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9d3c4505a800 from 1 10000000:01000000:1.0:1782756114.222854:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1782756114.222872:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: 00000000d173de0e/0x5e4fb0a8aa1988f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.222878:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: 00000000d173de0e/0x5e4fb0a8aa1988f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.222884:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: 00000000d173de0e/0x5e4fb0a8aa1988f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756114.222894:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ea5c4c45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222565504:0@lo:101: 00000100:00100000:1.0:1782756114.222927:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756114.223118:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set 000000003d8e5e0d going to sleep for 11 seconds 00000100:00100000:0.0:1782756114.223300:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222565504 00000100:00100000:0.0:1782756114.223305:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222565504 00000100:00100000:0.0:1782756114.223342:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782756114.223348:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000332acdd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+6:5784:x1869355222565504:12345-0@lo:101: 00010000:00010000:0.0:1782756114.223356:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756114.223368:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000067c01858/0x5e4fb0a8aa1988fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa1988f7 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756114.223383:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000067c01858/0x5e4fb0a8aa1988fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa1988f7 expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756114.223391:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000067c01858/0x5e4fb0a8aa1988fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa1988f7 expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756114.223398:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000067c01858, rc 0) 00000100:00100000:0.0:1782756114.223438:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000332acdd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+7:5784:x1869355222565504:12345-0@lo:101: Request processed in 91us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756114.223444:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782756114.223553:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ea5c4c45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222565504:0@lo:101: 00010000:00010000:1.0:1782756114.223564:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: 00000000d173de0e/0x5e4fb0a8aa1988f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa1988fe expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.223571:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: 00000000d173de0e/0x5e4fb0a8aa1988f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa1988fe expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756114.223582:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1782756114.223597:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: 00000000d173de0e/0x5e4fb0a8aa1988f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa1988fe expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.223604:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: 00000000d173de0e/0x5e4fb0a8aa1988f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa1988fe expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756114.223610:0:5784:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1782756114.223614:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782756114.223619:0:5784:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9d3c4505a800 10000000:01000000:1.0:1782756114.223621:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1782756114.223623:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1782756114.223625:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1782756114.223638:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: 000000009e13bf38/0x5e4fb0a8aa198905 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.223645:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: 000000009e13bf38/0x5e4fb0a8aa198905 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.223651:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: 000000009e13bf38/0x5e4fb0a8aa198905 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756114.223670:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ea5c4c45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222565632:0@lo:101: 00000100:00100000:1.0:1782756114.223695:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756114.223718:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set 000000003d8e5e0d going to sleep for 11 seconds 00000100:00100000:3.0:1782756114.223771:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222565632 00000100:00100000:3.0:1782756114.223776:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222565632 00000100:00100000:3.0:1782756114.223806:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782756114.223813:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007977d81e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+7:5784:x1869355222565632:12345-0@lo:101: 00010000:00010000:3.0:1782756114.223820:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756114.223833:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d9467ed8/0x5e4fb0a8aa19890c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198905 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756114.223847:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d9467ed8/0x5e4fb0a8aa19890c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198905 expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756114.223855:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d9467ed8/0x5e4fb0a8aa19890c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198905 expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756114.223861:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d9467ed8, rc 0) 00000100:00100000:3.0:1782756114.223890:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007977d81e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+8:5784:x1869355222565632:12345-0@lo:101: Request processed in 78us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756114.223896:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782756114.224013:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ea5c4c45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222565632:0@lo:101: 00010000:00010000:1.0:1782756114.224022:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: 000000009e13bf38/0x5e4fb0a8aa198905 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa19890c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.224028:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: 000000009e13bf38/0x5e4fb0a8aa198905 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa19890c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756114.224155:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ea5c4c45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222565760:0@lo:501: 00000100:00100000:1.0:1782756114.224178:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756114.224215:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set 000000003d8e5e0d going to sleep for 11 seconds 00000100:00100000:3.0:1782756114.224268:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222565760 00000100:00100000:3.0:1782756114.224273:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222565760 00000100:00100000:3.0:1782756114.224299:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782756114.224304:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d85df67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+8:5784:x1869355222565760:12345-0@lo:501: 00000100:00100000:3.0:1782756114.224492:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d85df67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+9:5784:x1869355222565760:12345-0@lo:501: Request processed in 188us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756114.224500:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782756114.224579:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ea5c4c45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222565760:0@lo:501: 00000100:00100000:0.0:1782756114.224605:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d1e3642d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222565888:0@lo:503: 00000100:00100000:0.0:1782756114.224644:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756114.224665:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set 000000004658d872 going to sleep for 11 seconds 00000100:00100000:3.0:1782756114.224714:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222565888 00000100:00100000:3.0:1782756114.224719:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222565888 00000100:00100000:3.0:1782756114.224735:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782756114.224740:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000652e1ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+9:5784:x1869355222565888:12345-0@lo:503: 00000100:00100000:3.0:1782756114.224878:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000652e1ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+9:5784:x1869355222565888:12345-0@lo:503: Request processed in 137us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756114.224884:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782756114.224959:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d1e3642d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222565888:0@lo:503: 00000100:00100000:0.0:1782756114.225468:0:5826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d1e3642d pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:5826:1869355222566016:0@lo:502: 00000100:00100000:0.0:1782756114.225509:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756114.225534:0:5826:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f9fd9bae going to sleep for 11 seconds 00000100:00100000:3.0:1782756114.225581:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222566016 00000100:00100000:3.0:1782756114.225586:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222566016 00000100:00100000:3.0:1782756114.225621:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782756114.225628:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e1aaa10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+9:5826:x1869355222566016:12345-0@lo:502: 00000100:00100000:3.0:1782756114.225774:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e1aaa10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+9:5826:x1869355222566016:12345-0@lo:502: Request processed in 147us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756114.225780:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782756114.225857:0:5826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d1e3642d pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:5826:1869355222566016:0@lo:502: 00000020:01000000:0.0:1782756114.225879:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782756114.225895:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782756114.225898:0:5826:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1782756114.225903:0:5826:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1782756114.225906:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782756114.225925:0:5826:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000e2082925) 00000020:00000080:0.0:1782756114.225944:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1782756114.225950:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1782756114.226024:0:5826:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1782756114.226032:0:5826:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5e4fb0a8aa19891a 00000020:00000080:0.0:1782756114.226354:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1782756114.226358:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782756114.226362:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782756114.226363:0:5826:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1782756114.226366:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782756114.226369:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782756114.226370:0:5826:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1782756114.226373:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782756114.226379:0:5826:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000094794dba) 00000020:00000080:0.0:1782756114.226388:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1782756114.226392:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1782756114.226393:0:5826:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1782756114.226396:0:5826:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1782756114.226402:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1782756114.226443:0:5826:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000aefb740c from lustre-MDT0000, refs=3 00000020:00000080:0.0:1782756114.226455:0:5826:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000079bc6552) 00000020:00000080:0.0:1782756114.226462:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1782756114.226522:0:5826:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1782756114.226528:0:5826:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5e4fb0a8aa19892f 00000020:00000080:0.0:1782756114.226619:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1782756114.226625:0:5826:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1782756114.226630:0:5826:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5e4fb0a8aa198936 00080000:01000000:0.0:1782756114.226635:0:5826:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1782756114.226638:0:5826:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5e4fb0a8aa19893d 00080000:10000000:0.0:1782756114.227022:0:5826:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1782756114.227542:0:5826:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1782756114.232297:0:5826:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1782756114.290245:0:5826:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1782756114.290617:0:5826:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1782756114.293748:0:5826:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1782756114.294107:0:5826:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1782756114.315254:0:5826:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000000d0c5cdf) 00000020:00000080:1.0:1782756114.315282:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1782756114.315342:0:5826:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:1.0:1782756114.315349:0:5826:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5e4fb0a8aa19894b 00000020:00000080:1.0:1782756114.315910:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1782756114.318587:0:5826:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1782756114.361011:0:5826:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1782756114.385985:0:5826:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1782756114.410542:0:5826:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1782756114.443616:0:5826:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1782756114.480756:0:5826:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1782756114.504667:0:5826:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5e4fb0a8aa198952 00000020:00000080:3.0:1782756114.505209:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1782756114.505220:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782756114.505225:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782756114.505227:0:5826:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1782756114.505230:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782756114.505234:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782756114.505235:0:5826:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782756114.505238:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782756114.505239:0:5826:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1782756114.505242:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782756114.505244:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782756114.505245:0:5826:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1782756114.505247:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782756114.505251:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782756114.505253:0:5826:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1782756114.505256:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1782756114.505299:0:5826:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1782756114.505361:0:5826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ab0e280d pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:5826:1869355222566144:0@lo:502: 00000100:00100000:3.0:1782756114.505438:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756114.505527:0:5826:0:(client.c:2701:ptlrpc_set_wait()) set 0000000005f59019 going to sleep for 11 seconds 00000100:00100000:1.0:1782756114.505605:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222566144 00000100:00100000:1.0:1782756114.505612:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222566144 00000100:00100000:1.0:1782756114.505891:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782756114.505909:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006325358c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+9:5826:x1869355222566144:12345-0@lo:502: 00000100:00100000:1.0:1782756114.506336:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006325358c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+9:5826:x1869355222566144:12345-0@lo:502: Request processed in 428us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756114.506345:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782756114.506473:0:5826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ab0e280d pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:5826:1869355222566144:0@lo:502: 00000020:01000000:0.0:1782756114.506505:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782756114.506511:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782756114.506513:0:5826:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1782756114.506516:0:5826:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1782756114.506780:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1782756114.506799:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1782756114.506821:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: 000000009e13bf38/0x5e4fb0a8aa198905 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa19890c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756114.506833:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: 000000009e13bf38/0x5e4fb0a8aa198905 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa19890c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782756114.506840:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9d3c4505a800 from 1 10000000:01000000:2.0:1782756114.506843:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782756114.506871:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: 00000000edc05510/0x5e4fb0a8aa198959 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756114.506879:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: 00000000edc05510/0x5e4fb0a8aa198959 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756114.506888:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: 00000000edc05510/0x5e4fb0a8aa198959 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756114.506903:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001ff3a08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222566272:0@lo:101: 00000100:00100000:2.0:1782756114.506961:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756114.506996:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set 000000007379279e going to sleep for 11 seconds 00000100:00100000:3.0:1782756114.507181:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222566272 00000100:00100000:3.0:1782756114.507187:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222566272 00000100:00100000:3.0:1782756114.507322:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782756114.507332:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea2d55d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+9:5784:x1869355222566272:12345-0@lo:101: 00010000:00010000:3.0:1782756114.507351:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756114.507364:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cdf97ae0/0x5e4fb0a8aa198960 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198959 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756114.507384:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cdf97ae0/0x5e4fb0a8aa198960 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198959 expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756114.507394:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cdf97ae0/0x5e4fb0a8aa198960 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198959 expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756114.507402:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cdf97ae0, rc 0) 00000100:00100000:3.0:1782756114.507443:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea2d55d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+10:5784:x1869355222566272:12345-0@lo:101: Request processed in 114us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756114.507449:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782756114.507513:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001ff3a08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222566272:0@lo:101: 00010000:00010000:2.0:1782756114.507528:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: 00000000edc05510/0x5e4fb0a8aa198959 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198960 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756114.507536:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: 00000000edc05510/0x5e4fb0a8aa198959 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198960 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756114.508137:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001ff3a08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222566400:0@lo:256: 00000100:00100000:2.0:1782756114.508178:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756114.508488:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set 000000007379279e going to sleep for 11 seconds 00000100:00100000:1.0:1782756114.508533:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222566400 00000100:00100000:1.0:1782756114.508538:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222566400 00000100:00100000:1.0:1782756114.508564:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782756114.508570:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f17fedf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+10:5784:x1869355222566400:12345-0@lo:256: 20000000:01000000:1.0:1782756114.508596:0:5797:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1782756114.508602:0:5797:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1782756114.508670:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f17fedf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+10:5784:x1869355222566400:12345-0@lo:256: Request processed in 100us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756114.508676:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782756114.508800:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001ff3a08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222566400:0@lo:256: 10000000:01000000:2.0:1782756114.509413:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782756114.509440:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: 00000000edc05510/0x5e4fb0a8aa198959 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198960 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756114.509450:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: 00000000edc05510/0x5e4fb0a8aa198959 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198960 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782756114.509458:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9d3c4505a800 from 1 10000000:01000000:2.0:1782756114.509461:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782756114.509488:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: 000000001d698782/0x5e4fb0a8aa198967 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756114.509496:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: 000000001d698782/0x5e4fb0a8aa198967 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756114.509504:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: 000000001d698782/0x5e4fb0a8aa198967 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756114.509527:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001ff3a08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222566528:0@lo:101: 00000100:00100000:2.0:1782756114.509565:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756114.509581:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set 000000007379279e going to sleep for 11 seconds 00000100:00100000:1.0:1782756114.509811:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222566528 00000100:00100000:1.0:1782756114.509818:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222566528 00000100:00100000:1.0:1782756114.509846:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782756114.509853:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec614445 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+10:5784:x1869355222566528:12345-0@lo:101: 00010000:00010000:1.0:1782756114.509862:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756114.509877:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000306a8a32/0x5e4fb0a8aa19896e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198967 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.509895:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000306a8a32/0x5e4fb0a8aa19896e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198967 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.509904:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000306a8a32/0x5e4fb0a8aa19896e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198967 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.509912:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000306a8a32, rc 0) 00000100:00100000:1.0:1782756114.509963:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec614445 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:5784:x1869355222566528:12345-0@lo:101: Request processed in 110us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756114.509969:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782756114.510058:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001ff3a08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222566528:0@lo:101: 00010000:00010000:2.0:1782756114.510070:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: 000000001d698782/0x5e4fb0a8aa198967 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa19896e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756114.510105:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: 000000001d698782/0x5e4fb0a8aa198967 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa19896e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756114.510153:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001ff3a08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222566656:0@lo:501: 00000100:00100000:2.0:1782756114.510180:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756114.510211:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set 000000007379279e going to sleep for 11 seconds 00000100:00100000:1.0:1782756114.510297:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222566656 00000100:00100000:1.0:1782756114.510303:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222566656 00000100:00100000:2.0:1782756114.510402:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782756114.510408:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a8c28a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:5784:x1869355222566656:12345-0@lo:501: 00000100:00100000:2.0:1782756114.511052:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a8c28a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:5784:x1869355222566656:12345-0@lo:501: Request processed in 643us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756114.511061:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782756114.511157:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001ff3a08a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222566656:0@lo:501: 00000100:00100000:1.0:1782756114.511204:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000137eb558 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222566784:0@lo:503: 00000100:00100000:1.0:1782756114.511245:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756114.511274:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set 0000000057eb444f going to sleep for 11 seconds 00000100:00100000:0.0:1782756114.511297:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222566784 00000100:00100000:0.0:1782756114.511302:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222566784 00000100:00100000:0.0:1782756114.511337:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782756114.511343:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004275971 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:5784:x1869355222566784:12345-0@lo:503: 00000040:00080000:0.0:1782756114.511380:0:5796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782756114.511426:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004275971 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:5784:x1869355222566784:12345-0@lo:503: Request processed in 83us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756114.511433:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782756114.511729:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000137eb558 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222566784:0@lo:503: 00000040:00080000:2.0:1782756114.515853:0:5830:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1782756114.516050:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1782756114.516069:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782756114.516112:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: 000000001d698782/0x5e4fb0a8aa198967 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa19896e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756114.516125:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: 000000001d698782/0x5e4fb0a8aa198967 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa19896e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782756114.516177:0:5784:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1782756114.516180:0:5784:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d3c4505a800 10000000:01000000:0.0:1782756114.516183:0:5784:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d3c4505a800 10000000:01000000:0.0:1782756114.516210:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782756114.516216:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9d3c4505a800 from 1 10000000:01000000:0.0:1782756114.516219:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782756114.516255:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: 000000008d58f389/0x5e4fb0a8aa198975 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756114.516264:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: 000000008d58f389/0x5e4fb0a8aa198975 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756114.516275:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: 000000008d58f389/0x5e4fb0a8aa198975 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756114.516297:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d1e3642d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222566912:0@lo:101: 00000100:00100000:0.0:1782756114.516366:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756114.516400:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set 00000000374726c4 going to sleep for 11 seconds 00000100:00100000:0.0:1782756114.516422:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222566912 00000100:00100000:0.0:1782756114.516428:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222566912 00000100:00100000:0.0:1782756114.516472:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782756114.516480:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008b6faf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:5784:x1869355222566912:12345-0@lo:101: 00010000:00010000:0.0:1782756114.516494:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756114.516506:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000047e43915/0x5e4fb0a8aa19897c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198975 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756114.516528:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000047e43915/0x5e4fb0a8aa19897c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198975 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756114.516537:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000047e43915/0x5e4fb0a8aa19897c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198975 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756114.516546:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000047e43915, rc 0) 00000100:00100000:0.0:1782756114.516670:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008b6faf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:5784:x1869355222566912:12345-0@lo:101: Request processed in 109us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756114.516678:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782756114.516727:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d1e3642d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222566912:0@lo:101: 00010000:00010000:0.0:1782756114.516740:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: 000000008d58f389/0x5e4fb0a8aa198975 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa19897c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756114.516748:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: 000000008d58f389/0x5e4fb0a8aa198975 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa19897c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756114.516791:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d1e3642d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222567040:0@lo:501: 00000100:00100000:0.0:1782756114.516814:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756114.516826:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set 00000000374726c4 going to sleep for 11 seconds 00000100:00100000:2.0:1782756114.516903:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222567040 00000100:00100000:2.0:1782756114.516907:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222567040 00000100:00100000:2.0:1782756114.516937:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782756114.516942:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081e7a3c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:5784:x1869355222567040:12345-0@lo:501: 00000100:00100000:2.0:1782756114.517213:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081e7a3c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:5784:x1869355222567040:12345-0@lo:501: Request processed in 271us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756114.517231:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782756114.517339:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d1e3642d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222567040:0@lo:501: 00000100:00100000:0.0:1782756114.517366:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d1e3642d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222567168:0@lo:503: 00000100:00100000:0.0:1782756114.517404:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756114.517434:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set 00000000374726c4 going to sleep for 11 seconds 00000100:00100000:2.0:1782756114.517536:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222567168 00000100:00100000:2.0:1782756114.517541:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222567168 00000100:00100000:2.0:1782756114.517574:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782756114.517581:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebd714ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:5784:x1869355222567168:12345-0@lo:503: 00000100:00100000:2.0:1782756114.518038:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebd714ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:5784:x1869355222567168:12345-0@lo:503: Request processed in 456us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756114.518045:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782756114.518948:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d1e3642d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222567168:0@lo:503: 00000100:00100000:0.0:1782756114.519802:0:5831:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d1e3642d pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:5831:1869355222567296:0@lo:502: 00000100:00100000:0.0:1782756114.519860:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756114.519929:0:5831:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e4cd764d going to sleep for 11 seconds 00000100:00100000:2.0:1782756114.519960:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222567296 00000100:00100000:2.0:1782756114.519966:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222567296 00000100:00100000:2.0:1782756114.520045:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782756114.520053:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009046c1ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:5831:x1869355222567296:12345-0@lo:502: 00000100:00100000:2.0:1782756114.520476:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009046c1ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:5831:x1869355222567296:12345-0@lo:502: Request processed in 424us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756114.520484:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782756114.520549:0:5831:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d1e3642d pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:5831:1869355222567296:0@lo:502: 00000020:01000004:0.0:1782756114.520685:0:5831:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1782756114.520700:0:5831:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000078fd8e48) 00000020:00000080:0.0:1782756114.520719:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1782756114.520986:0:5831:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000aefb740c from lustre-MDT0000, refs=4 00000020:01000004:0.0:1782756114.520997:0:5831:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000aefb740c from lustre-MDT0000, refs=4 00000020:01000004:0.0:1782756114.520999:0:5831:0:(obd_mount.c:701:lustre_put_lsi()) put 00000000aefb740c 4 00010000:00080000:0.0:1782756114.521024:0:5831:0:(ldlm_lib.c:102:import_set_conn()) imp 000000001e085c40@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.125@tcp at head 00010000:00010000:0.0:1782756114.522822:0:5831:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1782756114.522920:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1782756114.522953:0:5831:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1782756114.522981:0:5831:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5e4fb0a8aa19898a 00000100:00080000:0.0:1782756114.522992:0:5831:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782756114.522997:0:5831:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000001e085c40 using connection 192.168.204.125@tcp/0@lo 00000100:00100000:0.0:1782756114.523041:0:5831:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d1e3642d x1869355222567424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782756114.523153:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d1e3642d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869355222567424:0@lo:38: 00000100:00100000:1.0:1782756114.523231:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756114.523334:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222567424 00000100:00100000:0.0:1782756114.523341:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222567424 00000100:00100000:0.0:1782756114.523381:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782756114.523388:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000137eb558 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1869355222567424:12345-0@lo:38: 00000100:00100000:0.0:1782756114.523532:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000137eb558 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1869355222567424:12345-0@lo:38: Request processed in 142us (301us total) trans 0 rc -11/-11 00000100:00100000:0.0:1782756114.523539:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1782756114.523555:0:5831:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1782756114.523890:0:5831:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000096d5f226 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:5831:1869355222567552:0@lo:502: 00000100:00100000:0.0:1782756114.523934:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756114.523961:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222567552 00000100:00100000:0.0:1782756114.523965:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222567552 00000100:00100000:0.0:1782756114.523994:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782756114.524000:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae91cecd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:5831:x1869355222567552:12345-0@lo:502: 00000100:00100000:0.0:1782756114.524277:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae91cecd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:5831:x1869355222567552:12345-0@lo:502: Request processed in 276us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756114.524285:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782756114.524336:0:5831:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e4cd764d going to sleep for 11 seconds 00000100:00100000:0.0:1782756114.524355:0:5831:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000096d5f226 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:5831:1869355222567552:0@lo:502: 00000040:00080000:0.0:1782756114.524383:0:5831:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:1.0:1782756114.524906:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782756114.524912:0:3313:0:(import.c:65:import_set_state_nolock()) 000000001e085c40 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782756114.524917:0:3313:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1782756114.524920:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d1e3642d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869355222567424:0@lo:38: 00000020:01000000:2.0:1782756114.525378:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1782756114.525400:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782756114.525425:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: 000000008d58f389/0x5e4fb0a8aa198975 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa19897c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756114.525437:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: 000000008d58f389/0x5e4fb0a8aa198975 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa19897c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782756114.525490:0:5784:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782756114.525493:0:5784:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782756114.525494:0:5784:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782756114.525495:0:5784:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782756114.525497:0:5784:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782756114.525502:0:5784:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782756114.525504:0:5784:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782756114.525505:0:5784:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782756114.525506:0:5784:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782756114.525508:0:5784:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782756114.525509:0:5784:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782756114.525511:0:5784:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782756114.525514:0:5784:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1782756114.525517:0:5784:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782756114.525518:0:5784:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782756114.525519:0:5784:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782756114.525520:0:5784:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782756114.525521:0:5784:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782756114.525521:0:5784:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782756114.525522:0:5784:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782756114.525523:0:5784:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782756114.525523:0:5784:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782756114.525524:0:5784:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782756114.525525:0:5784:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782756114.525526:0:5784:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782756114.525548:0:5784:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1782756114.525562:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a915c5fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222567680:0@lo:253: 00000100:00100000:2.0:1782756114.525611:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756114.525646:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b972991f going to sleep for 11 seconds 00000100:00100000:3.0:1782756114.525724:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222567680 00000100:00100000:3.0:1782756114.525776:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222567680 00000100:00100000:3.0:1782756114.525818:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782756114.525829:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b42ec737 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:5784:x1869355222567680:12345-0@lo:253: 20000000:01000000:3.0:1782756114.525855:0:5796:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1782756114.525868:0:5796:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1782756114.557927:0:5796:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1782756114.557950:0:5796:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1782756114.558012:0:5819:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1782756114.558018:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1782756114.558037:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b0e1c17f/0x5e4fb0a8aa198991 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.558066:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cdf97ae0/0x5e4fb0a8aa198960 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198959 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.558090:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b0e1c17f/0x5e4fb0a8aa198991 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.558129:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cdf97ae0/0x5e4fb0a8aa198960 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa198959 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.558156:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cdf97ae0/0x5e4fb0a8aa198960 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198959 expref: 12 pid: 5798 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756114.558170:0:5819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003d05873d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5819:1869355222567808:0@lo:104: 00000100:00100000:1.0:1782756114.558244:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756114.558299:0:5819:0:(client.c:2701:ptlrpc_set_wait()) set 0000000057eb444f going to sleep for 11 seconds 00000100:00100000:2.0:1782756114.558732:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222567808 00000100:00100000:2.0:1782756114.558741:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222567808 00000100:00100000:2.0:1782756114.558782:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782756114.558791:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1a2f582 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0daec403-69b6-4c98-a0ea-f519ca0a480f+3:5819:x1869355222567808:12345-0@lo:104: 00010000:00010000:2.0:1782756114.558804:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: 00000000edc05510/0x5e4fb0a8aa198959 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198960 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756114.558872:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782756114.558878:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1a2f582 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0daec403-69b6-4c98-a0ea-f519ca0a480f+3:5819:x1869355222567808:12345-0@lo:104: Request processed in 88us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756114.558894:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782756114.559048:0:5819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003d05873d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5819:1869355222567808:0@lo:104: 00010000:00010000:0.0:1782756114.559068:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b0e1c17f/0x5e4fb0a8aa198991 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.559320:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782756114.559325:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: 00000000edc05510/0x5e4fb0a8aa198959 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198960 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.559342:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000edc05510 already unused, calling callback (000000005568db5d) 10000000:00010000:1.0:1782756114.559345:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: 00000000edc05510/0x5e4fb0a8aa198959 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa198960 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.559352:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: 00000000edc05510/0x5e4fb0a8aa198959 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa198960 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782756114.559358:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: 00000000edc05510/0x5e4fb0a8aa198959 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa198960 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756114.559363:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782756114.559390:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: 00000000edc05510/0x5e4fb0a8aa198959 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198960 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.559396:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782756114.559412:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: 00000000edc05510/0x5e4fb0a8aa198959 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198960 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.559418:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: 00000000edc05510/0x5e4fb0a8aa198959 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198960 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.559441:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756114.559442:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756114.559444:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756114.559498:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007764266e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0daec403-69b6-4c98-a0ea-f519ca0a480f:3315:1869355222567936:0@lo:103: 00000100:00100000:1.0:1782756114.559535:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756114.559776:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222567936 00000100:00100000:1.0:1782756114.559781:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222567936 00010000:00010000:1.0:1782756114.559799:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cdf97ae0/0x5e4fb0a8aa198960 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198959 expref: 13 pid: 5798 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756114.559858:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782756114.559865:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a556aaec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:3315:x1869355222567936:12345-0@lo:103: 00010000:00010000:1.0:1782756114.559874:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756114.559878:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cdf97ae0/0x5e4fb0a8aa198960 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198959 expref: 13 pid: 5798 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.559888:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cdf97ae0/0x5e4fb0a8aa198960 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198959 expref: 13 pid: 5798 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.559899:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cdf97ae0/0x5e4fb0a8aa198960 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa198959 expref: 13 pid: 5798 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.559912:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b0e1c17f/0x5e4fb0a8aa198991 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.559919:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b0e1c17f/0x5e4fb0a8aa198991 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782756114.559932:0:5788:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001915694s 00010000:00010000:1.0:1782756114.559942:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b0e1c17f/0x5e4fb0a8aa198991 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.559948:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b0e1c17f/0x5e4fb0a8aa198991 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.559953:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b0e1c17f/0x5e4fb0a8aa198991 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.559958:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b0e1c17f/0x5e4fb0a8aa198991 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.559963:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b0e1c17f already unused, calling callback (000000002fba626f) 00010000:00010000:1.0:1782756114.559965:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b0e1c17f/0x5e4fb0a8aa198991 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.559971:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b0e1c17f/0x5e4fb0a8aa198991 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.559986:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b0e1c17f/0x5e4fb0a8aa198991 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756114.559994:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782756114.560022:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a556aaec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:3315:x1869355222567936:12345-0@lo:103: Request processed in 159us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756114.560029:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782756114.560441:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007764266e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0daec403-69b6-4c98-a0ea-f519ca0a480f:3315:1869355222567936:0@lo:103: 00010000:00010000:2.0:1782756114.560463:0:5819:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b0e1c17f/0x5e4fb0a8aa198991 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756114.560470:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b0e1c17f/0x5e4fb0a8aa198991 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756114.560475:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b0e1c17f/0x5e4fb0a8aa198991 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756114.569376:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b42ec737 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:5784:x1869355222567680:12345-0@lo:253: Request processed in 43539us (43755us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756114.569392:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782756114.569399:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a915c5fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:5784:1869355222567680:0@lo:253: 10000000:01000000:0.0:1782756114.569413:0:5784:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1782756114.569416:0:5784:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782756114.569418:0:5784:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782756114.569419:0:5784:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782756114.569420:0:5784:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782756114.569421:0:5784:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782756114.569423:0:5784:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782756114.569424:0:5784:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782756114.569425:0:5784:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782756114.569426:0:5784:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782756114.569428:0:5784:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782756114.569429:0:5784:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782756114.569430:0:5784:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1782756114.569502:0:5784:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1782756114.578101:0:5784:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1782756114.578474:0:5784:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1782756114.578652:0:5784:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1782756114.578793:0:5784:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1782756114.578999:0:5784:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1782756114.579211:0:5784:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1782756114.584404:0:5784:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1782756114.584760:0:5784:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1782756114.584977:0:5784:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1782756114.585371:0:5784:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1782756114.586129:0:5784:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1782756114.586347:0:5784:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1782756114.627212:0:5784:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1782756114.652677:0:5784:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1782756114.652932:0:5836:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1782756114.652936:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1782756114.653142:0:5837:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1782756114.661503:0:5784:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1782756114.661998:0:5784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1782756114.663258:0:5784:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1782756114.663270:0:5784:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1782756114.663571:0:5784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782756114.667487:0:5784:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1782756114.668876:0:5784:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1782756114.668926:0:5784:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1782756114.669765:0:5784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1782756114.670862:0:5784:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1782756114.676830:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1782756114.677496:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1782756114.677774:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1782756114.677932:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1782756114.678824:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1782756114.679373:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1782756114.679623:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1782756114.679887:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00000040:00080000:0.0:1782756114.682460:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:2.0:1782756114.682757:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1782756114.683520:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1782756114.683835:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1782756114.684027:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1782756114.684585:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1782756114.684821:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1782756114.685271:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1782756114.685625:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1782756114.686228:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1782756114.686557:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1782756114.686802:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1782756114.687017:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1782756114.687803:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1782756114.688429:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1782756114.688738:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1782756114.689039:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1782756114.689623:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1782756114.690038:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1782756114.690533:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1782756114.690809:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1782756114.692447:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1782756114.692850:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1782756114.693037:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1782756114.693802:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1782756114.694378:0:5784:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1782756114.739631:0:5837:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1782756114.739715:0:5837:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1782756114.739720:0:5837:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:0.0:1782756114.768525:0:5784:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1782756114.768562:0:5784:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa98c01633988 00100000:10000000:0.0:1782756114.768570:0:5784:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1782756114.769574:0:5784:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1782756114.769590:0:5784:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.125@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1782756114.769606:0:5784:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1782756114.769625:0:5784:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1782756114.897670:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756115.917106:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756116.940200:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782756117.673006:0:6079:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1782756117.964281:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756118.988377:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782756120.012308:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782756120.012317:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9d3c4505a800 from 3 10000000:01000000:2.0:1782756120.012322:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782756120.012369:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: 00000000edc05510/0x5e4fb0a8aa198998 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756120.012381:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: 00000000edc05510/0x5e4fb0a8aa198998 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756120.012405:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: 00000000edc05510/0x5e4fb0a8aa198998 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756120.012427:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e7f7f2dc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222568064:0@lo:101: 00000100:00100000:2.0:1782756120.012500:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756120.012557:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e7f705a5 going to sleep for 11 seconds 00000100:00080000:2.0:1782756120.012820:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1782756120.012826:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1782756120.012828:0:36:0:(import.c:65:import_set_state_nolock()) 000000001e085c40 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782756120.012836:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000001e085c40 using connection 192.168.204.125@tcp/0@lo 00000100:00100000:2.0:1782756120.012857:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b0efb91b x1869355222568192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782756120.013613:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222568064 00000100:00100000:0.0:1782756120.013632:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222568064 00000100:00100000:0.0:1782756120.013683:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782756120.013693:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000666eefa3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:5800:x1869355222568064:12345-0@lo:101: 00010000:00010000:0.0:1782756120.013707:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756120.013721:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756120.013722:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000098bd305f/0x5e4fb0a8aa19899f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198998 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756120.013723:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b0efb91b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869355222568192:0@lo:38: 00010000:00010000:0.0:1782756120.013752:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000098bd305f/0x5e4fb0a8aa19899f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198998 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756120.013779:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756120.013939:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222568192 00000100:00100000:1.0:1782756120.013949:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222568192 00010000:00010000:0.0:1782756120.013960:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000098bd305f/0x5e4fb0a8aa19899f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198998 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756120.013971:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000098bd305f, rc 0) 00000100:00100000:0.0:1782756120.014066:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000666eefa3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:5800:x1869355222568064:12345-0@lo:101: Request processed in 376us (1566us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756120.014069:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e7f7f2dc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222568064:0@lo:101: 00000100:00100000:0.0:1782756120.014114:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1782756120.014212:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: 00000000edc05510/0x5e4fb0a8aa198998 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa19899f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756120.014221:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: 00000000edc05510/0x5e4fb0a8aa198998 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa19899f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756120.014277:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000438c71ac pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222568320:0@lo:256: 00000100:00100000:3.0:1782756120.014326:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756120.014666:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ef4d5f67 going to sleep for 11 seconds 00000100:00100000:0.0:1782756120.014705:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222568320 00000100:00100000:0.0:1782756120.014709:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222568320 00000100:00100000:0.0:1782756120.014779:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782756120.014788:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6ba47a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:5800:x1869355222568320:12345-0@lo:256: 20000000:01000000:0.0:1782756120.014803:0:5796:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782756120.014819:0:5796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782756120.014822:0:5796:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1782756120.014911:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6ba47a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:5800:x1869355222568320:12345-0@lo:256: Request processed in 125us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756120.014918:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782756120.014984:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000438c71ac pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222568320:0@lo:256: 00000100:00100000:1.0:1782756120.015011:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782756120.015025:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027216f38 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1869355222568192:12345-0@lo:38: 10000000:01000000:3.0:1782756120.015027:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782756120.015037:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: 00000000edc05510/0x5e4fb0a8aa198998 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa19899f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756120.015045:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: 00000000edc05510/0x5e4fb0a8aa198998 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa19899f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1782756120.015049:0:5805:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:1.0:1782756120.015124:0:5805:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5e4fb0a8aa1989a6 00000004:00100000:1.0:1782756120.015165:0:5805:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782756120.015363:0:5805:0:(import.c:65:import_set_state_nolock()) 00000000cefc0183 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782756120.015413:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027216f38 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869355222568192:12345-0@lo:38: Request processed in 388us (1635us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756120.015421:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1782756120.015487:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b0efb91b x1869355222568192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782756130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782756120.015502:0:3313:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1782756120.015509:0:3313:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1782756120.015514:0:3313:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1782756120.015516:0:3313:0:(import.c:65:import_set_state_nolock()) 000000001e085c40 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1782756120.015521:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b0efb91b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869355222568192:0@lo:38: 00010000:00010000:3.0:1782756121.036252:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782756121.636740:0:6281:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffbe230880 20000000:00000080:3.0:1782756121.636763:0:6281:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d3c8095cc00 uarg=0000000000000000 20000000:01000000:3.0:1782756121.636812:0:6281:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1782756121.636820:0:6281:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1782756121.636826:0:6281:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1782756121.637228:0:6281:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1782756121.637242:0:6281:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1782756121.643945:0:6281:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782756121.644396:0:6281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1782756121.644468:0:6281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1782756121.644522:0:6281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1782756121.644548:0:6281:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1782756121.644575:0:6281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000088088607/0x5e4fb0a8aa1989ad lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756121.645461:0:6281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000306a8a32/0x5e4fb0a8aa19896e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198967 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756121.645471:0:6281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000088088607/0x5e4fb0a8aa1989ad lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756121.645514:0:6281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000306a8a32/0x5e4fb0a8aa19896e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa198967 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756121.645544:0:6281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000306a8a32/0x5e4fb0a8aa19896e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198967 expref: 11 pid: 5797 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756121.645561:0:6281:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000082b6b5c9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6281:1869355222568448:0@lo:104: 00000100:00100000:2.0:1782756121.646907:0:6281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756121.647297:0:6281:0:(client.c:2701:ptlrpc_set_wait()) set 000000006d1d6f5e going to sleep for 11 seconds 00000100:00100000:1.0:1782756121.647310:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222568448 00000100:00100000:1.0:1782756121.647320:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222568448 00000100:00100000:1.0:1782756121.647396:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782756121.647407:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022c77add pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+3:6281:x1869355222568448:12345-0@lo:104: 00010000:00010000:1.0:1782756121.647428:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: 000000001d698782/0x5e4fb0a8aa198967 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa19896e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756121.647526:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782756121.647532:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022c77add pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+3:6281:x1869355222568448:12345-0@lo:104: Request processed in 127us (1894us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756121.647540:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782756121.647704:0:6281:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000082b6b5c9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6281:1869355222568448:0@lo:104: 00010000:00010000:3.0:1782756121.647728:0:6281:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000088088607/0x5e4fb0a8aa1989ad lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756121.647784:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782756121.647790:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: 000000001d698782/0x5e4fb0a8aa198967 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa19896e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756121.647811:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001d698782 already unused, calling callback (000000005568db5d) 10000000:00010000:0.0:1782756121.647814:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: 000000001d698782/0x5e4fb0a8aa198967 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa19896e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756121.647822:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: 000000001d698782/0x5e4fb0a8aa198967 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa19896e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782756121.647827:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: 000000001d698782/0x5e4fb0a8aa198967 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa19896e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782756121.647832:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782756121.647875:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: 000000001d698782/0x5e4fb0a8aa198967 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa19896e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756121.647881:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782756121.647910:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: 000000001d698782/0x5e4fb0a8aa198967 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa19896e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756121.647917:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: 000000001d698782/0x5e4fb0a8aa198967 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa19896e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756121.647933:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756121.647934:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756121.647936:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756121.648065:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000096d5f226 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222568576:0@lo:103: 00000100:00100000:1.0:1782756121.648261:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756121.648410:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222568576 00000100:00100000:2.0:1782756121.648416:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222568576 00010000:00010000:2.0:1782756121.648439:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000306a8a32/0x5e4fb0a8aa19896e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198967 expref: 12 pid: 5797 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756121.648470:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782756121.648476:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056c1ea3c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:3316:x1869355222568576:12345-0@lo:103: 00010000:00010000:2.0:1782756121.648487:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756121.648491:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000306a8a32/0x5e4fb0a8aa19896e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198967 expref: 12 pid: 5797 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756121.648500:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000306a8a32/0x5e4fb0a8aa19896e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198967 expref: 12 pid: 5797 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756121.648514:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000306a8a32/0x5e4fb0a8aa19896e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa198967 expref: 12 pid: 5797 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756121.648527:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000088088607/0x5e4fb0a8aa1989ad lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756121.648534:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000088088607/0x5e4fb0a8aa1989ad lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756121.648560:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000088088607/0x5e4fb0a8aa1989ad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756121.648567:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000088088607/0x5e4fb0a8aa1989ad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756121.648572:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000088088607/0x5e4fb0a8aa1989ad lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756121.648577:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000088088607/0x5e4fb0a8aa1989ad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756121.648582:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000088088607 already unused, calling callback (000000002fba626f) 00010000:00010000:2.0:1782756121.648585:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000088088607/0x5e4fb0a8aa1989ad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756121.648592:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000088088607/0x5e4fb0a8aa1989ad lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756121.655230:0:6281:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000088088607/0x5e4fb0a8aa1989ad lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756121.655251:0:6281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000088088607/0x5e4fb0a8aa1989ad lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756121.656174:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000088088607/0x5e4fb0a8aa1989ad lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756121.656190:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000088088607/0x5e4fb0a8aa1989ad lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756121.656214:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756121.656396:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056c1ea3c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:3316:x1869355222568576:12345-0@lo:103: Request processed in 7916us (8132us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756121.656407:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782756121.657494:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000096d5f226 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222568576:0@lo:103: 00010000:00010000:3.0:1782756122.060207:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756123.084306:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756124.110206:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756125.132712:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000adafb731 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222568704:0@lo:400: 00000100:00100000:0.0:1782756125.132792:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756125.132856:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000966bdd96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869355222568832:0@lo:400: 00000100:00100000:0.0:1782756125.132899:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756125.133005:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222568704 00000100:00100000:0.0:1782756125.133012:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222568704 00000100:00100000:0.0:1782756125.133064:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782756125.133094:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020c47c36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:3317:x1869355222568704:12345-0@lo:400: 00000100:00100000:0.0:1782756125.133149:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020c47c36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:3317:x1869355222568704:12345-0@lo:400: Request processed in 78us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756125.133157:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782756125.133196:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222568832 00000100:00100000:0.0:1782756125.133200:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222568832 00000100:00100000:0.0:1782756125.133239:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782756125.133246:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1782756125.133248:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032190579 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869355222568832:12345-0@lo:400: 00000100:00100000:3.0:1782756125.133257:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1782756125.133292:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032190579 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869355222568832:12345-0@lo:400: Request processed in 47us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756125.133299:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1782756125.133338:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000966bdd96 x1869355222568832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782756141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756125.133352:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000966bdd96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869355222568832:0@lo:400: 00000100:00100000:0.0:1782756125.133377:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000adafb731 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222568704:0@lo:400: 00010000:00010000:3.0:1782756125.135921:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1782756125.576420:0:6600:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1782756125.576424:0:6600:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1782756125.576555:0:6600:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000006dd0947c 00000020:01000004:0.0:1782756125.576571:0:6600:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1782756125.576582:0:6600:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1782756125.576605:0:6600:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (000000007cf4e945) 00000020:00000080:0.0:1782756125.576622:0:6600:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1782756125.593543:0:6600:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1782756125.593965:0:6600:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1782756125.610653:0:6600:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1782756125.614854:0:6600:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1782756125.614888:0:6600:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1782756125.614946:0:6600:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1782756125.614999:0:6600:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1782756125.615413:0:6600:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1782756125.615424:0:6600:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1782756125.615433:0:6600:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5e4fb0a8aa1989bb 00000020:01000004:1.0:1782756125.615441:0:6600:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1782756125.615460:0:6600:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.125@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1782756125.615463:0:6600:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1782756125.615468:0:6600:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1782756125.615473:0:6600:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1782756125.615483:0:6600:0:(genops.c:413:class_newdev()) Allocate new device OSS (00000000cc23950b) 00000020:00000080:1.0:1782756125.615493:0:6600:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1782756125.616586:0:6600:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782756125.616720:0:6600:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1782756125.616726:0:6600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1782756125.618065:0:6600:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1782756125.618152:0:6600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1782756125.618665:0:6600:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1782756125.618676:0:6600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1782756125.620764:0:6600:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782756125.621067:0:6600:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1782756125.621131:0:6600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1782756125.621545:0:6600:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1782756125.621551:0:6600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1782756125.639164:0:6600:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782756125.639468:0:6600:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1782756125.639476:0:6600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1782756125.641563:0:6600:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1782756125.641576:0:6600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1782756125.642790:0:6600:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1782756125.642799:0:6600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1782756125.645321:0:6600:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782756125.645496:0:6600:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1782756125.645502:0:6600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1782756125.646820:0:6600:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1782756125.646830:0:6600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1782756125.683432:0:6600:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782756125.683593:0:6600:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1782756125.683599:0:6600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1782756125.684552:0:6600:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1782756125.684561:0:6600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1782756125.685015:0:6600:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1782756125.685037:0:6600:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1782756125.685043:0:6600:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.125@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1782756125.702421:0:6600:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.125@tcp ctxt 0 is initialized 00000020:01000004:0.0:1782756125.702459:0:6600:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.125@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1782756125.702463:0:6600:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1782756125.702466:0:6600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782756125.702467:0:6600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782756125.702468:0:6600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782756125.702469:0:6600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782756125.702470:0:6600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782756125.702472:0:6600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782756125.702473:0:6600:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782756125.702474:0:6600:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782756125.702476:0:6600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782756125.702477:0:6600:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782756125.702480:0:6600:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1782756125.702482:0:6600:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782756125.702484:0:6600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782756125.702485:0:6600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782756125.702486:0:6600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782756125.702487:0:6600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782756125.702487:0:6600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782756125.702489:0:6600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782756125.702489:0:6600:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782756125.702490:0:6600:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782756125.702495:0:6600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782756125.702496:0:6600:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782756125.702522:0:6600:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1782756125.702538:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000adafb731 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222568960:0@lo:253: 00000100:00100000:0.0:1782756125.702617:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756125.702793:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set 0000000002a171e7 going to sleep for 11 seconds 00000100:00100000:2.0:1782756125.702841:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222568960 00000100:00100000:2.0:1782756125.702848:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222568960 00000100:00100000:2.0:1782756125.702921:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782756125.702930:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c86ece3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:6600:x1869355222568960:12345-0@lo:253: 20000000:01000000:2.0:1782756125.702959:0:5796:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1782756125.702962:0:5796:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1782756125.702967:0:5796:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1782756125.702980:0:5796:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1782756125.704309:0:5796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782756125.704519:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1782756125.704534:0:5796:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1782756125.704571:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1782756125.704578:0:5796:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1782756125.704609:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1782756125.704733:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1782756125.705184:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1782756125.705204:0:5796:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.125@tcp 20000000:01000000:2.0:1782756125.705205:0:5796:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.125@tcp (null) (null) (null) 00000040:00080000:2.0:1782756125.705241:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1782756125.705249:0:5796:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1782756125.705296:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1782756125.705304:0:5796:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.125@tcp (null) (null) 00000040:00080000:2.0:1782756125.705335:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1782756125.705344:0:5796:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1782756125.705372:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1782756125.705422:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1782756125.707395:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1782756125.707425:0:5796:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.125@tcp 20000000:01000000:3.0:1782756125.707428:0:5796:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.125@tcp (null) (null) (null) 00000040:00080000:3.0:1782756125.707499:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1782756125.707510:0:5796:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1782756125.707543:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1782756125.707550:0:5796:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.125@tcp (null) (null) 00000040:00080000:3.0:1782756125.707593:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1782756125.707602:0:5796:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1782756125.707629:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1782756125.707738:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1782756125.707760:0:5796:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1782756125.707763:0:5796:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1782756125.707768:0:5796:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1782756125.707769:0:5796:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1782756125.707771:0:5796:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1782756125.707782:0:5796:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1782756125.707785:0:5796:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1782756125.707821:0:5796:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1782756125.707823:0:5796:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1782756125.708424:0:6615:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1782756125.708475:0:6615:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1782756125.708532:0:6615:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1782756125.708879:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1782756125.708922:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1782756125.708991:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1782756125.709004:0:5796:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1782756125.709006:0:5796:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1782756125.709486:0:6616:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1782756125.709531:0:6616:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1782756125.709579:0:6616:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1782756125.709885:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1782756125.709925:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1782756125.709958:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1782756125.709982:0:5796:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1782756125.709984:0:5796:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1782756125.710416:0:6617:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1782756125.710625:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1782756125.710751:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1782756125.710843:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:3.0:1782756125.710868:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1782756125.710883:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000a453569/0x5e4fb0a8aa1989c9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.710900:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009906f227/0x5e4fb0a8aa1988f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa1988e9 expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.710907:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d9467ed8/0x5e4fb0a8aa19890c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198905 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.710914:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000047e43915/0x5e4fb0a8aa19897c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198975 expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.710920:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000000a453569/0x5e4fb0a8aa1989c9 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.710954:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000047e43915/0x5e4fb0a8aa19897c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa198975 expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.710979:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000047e43915/0x5e4fb0a8aa19897c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198975 expref: 11 pid: 5796 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756125.710993:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000438c71ac pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1869355222569088:0@lo:104: 00000100:00100000:3.0:1782756125.711054:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782756125.711194:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d9467ed8/0x5e4fb0a8aa19890c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa198905 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.711203:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d9467ed8/0x5e4fb0a8aa19890c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198905 expref: 11 pid: 5797 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756125.711211:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bf149440 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1869355222569216:0@lo:104: 00000100:00100000:3.0:1782756125.711242:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782756125.711350:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009906f227/0x5e4fb0a8aa1988f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa1988e9 expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.711358:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009906f227/0x5e4fb0a8aa1988f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa1988e9 expref: 11 pid: 5796 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756125.711365:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002c450568 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1869355222569344:0@lo:104: 00000100:00100000:3.0:1782756125.711387:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756125.711439:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222569088 00000100:00100000:1.0:1782756125.711445:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222569088 00000100:00100000:1.0:1782756125.711478:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222569216 00000100:00100000:1.0:1782756125.711481:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222569216 00000100:00100000:1.0:1782756125.711494:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782756125.711501:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055c949c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+4:5796:x1869355222569088:12345-0@lo:104: 00010000:00010000:1.0:1782756125.711512:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: 000000008d58f389/0x5e4fb0a8aa198975 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa19897c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.711578:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782756125.711584:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055c949c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+4:5796:x1869355222569088:12345-0@lo:104: Request processed in 84us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756125.711591:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782756125.711607:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782756125.711612:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046954721 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+3:5796:x1869355222569216:12345-0@lo:104: 00010000:00010000:1.0:1782756125.711619:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: 000000009e13bf38/0x5e4fb0a8aa198905 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa19890c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.711648:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782756125.711652:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046954721 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+3:5796:x1869355222569216:12345-0@lo:104: Request processed in 41us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756125.711738:0:5796:0:(client.c:2701:ptlrpc_set_wait()) set 00000000fe3c4ccd going to sleep for 11 seconds 00000100:00100000:3.0:1782756125.711758:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000438c71ac pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1869355222569088:0@lo:104: 00000100:00100000:3.0:1782756125.711766:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bf149440 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1869355222569216:0@lo:104: 00000100:00100000:1.0:1782756125.711808:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782756125.711820:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222569344 00000100:00100000:1.0:1782756125.711823:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222569344 00000100:00100000:1.0:1782756125.711837:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782756125.711841:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051e66e1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+3:5796:x1869355222569344:12345-0@lo:104: 00010000:00010000:1.0:1782756125.711848:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: 000000005f2feb9e/0x5e4fb0a8aa1988e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa1988f0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.711887:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1782756125.711891:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051e66e1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+3:5796:x1869355222569344:12345-0@lo:104: Request processed in 50us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756125.711897:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1782756125.711913:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782756125.711917:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: 000000008d58f389/0x5e4fb0a8aa198975 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa19897c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.711935:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008d58f389 already unused, calling callback (000000005568db5d) 10000000:00010000:1.0:1782756125.711938:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: 000000008d58f389/0x5e4fb0a8aa198975 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa19897c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.711944:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: 000000008d58f389/0x5e4fb0a8aa198975 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa19897c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782756125.711949:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: 000000008d58f389/0x5e4fb0a8aa198975 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa19897c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756125.711954:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782756125.711994:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: 000000008d58f389/0x5e4fb0a8aa198975 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa19897c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.712000:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782756125.712017:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: 000000008d58f389/0x5e4fb0a8aa198975 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa19897c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.712024:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: 000000008d58f389/0x5e4fb0a8aa198975 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa19897c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.712038:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782756125.712040:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: 000000009e13bf38/0x5e4fb0a8aa198905 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa19890c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.712045:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009e13bf38 already unused, calling callback (000000005568db5d) 10000000:00010000:1.0:1782756125.712047:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: 000000009e13bf38/0x5e4fb0a8aa198905 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa19890c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.712062:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: 000000009e13bf38/0x5e4fb0a8aa198905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa19890c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782756125.712067:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: 000000009e13bf38/0x5e4fb0a8aa198905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa19890c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756125.712099:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782756125.712113:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: 000000009e13bf38/0x5e4fb0a8aa198905 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa19890c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.712119:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782756125.712132:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: 000000009e13bf38/0x5e4fb0a8aa198905 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa19890c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.712138:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: 000000009e13bf38/0x5e4fb0a8aa198905 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa19890c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.712147:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782756125.712149:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: 000000005f2feb9e/0x5e4fb0a8aa1988e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa1988f0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.712155:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005f2feb9e already unused, calling callback (000000005568db5d) 10000000:00010000:1.0:1782756125.712156:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: 000000005f2feb9e/0x5e4fb0a8aa1988e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa1988f0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.712161:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: 000000005f2feb9e/0x5e4fb0a8aa1988e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa1988f0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782756125.712166:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: 000000005f2feb9e/0x5e4fb0a8aa1988e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa1988f0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756125.712179:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782756125.712192:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: 000000005f2feb9e/0x5e4fb0a8aa1988e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa1988f0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.712197:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782756125.712201:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: 000000005f2feb9e/0x5e4fb0a8aa1988e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa1988f0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.712207:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: 000000005f2feb9e/0x5e4fb0a8aa1988e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa1988f0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.712220:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756125.712222:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756125.712223:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756125.712240:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005fc4af82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0daec403-69b6-4c98-a0ea-f519ca0a480f:3315:1869355222569472:0@lo:103: 00000100:00100000:1.0:1782756125.712268:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756125.712303:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e3292d8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222569600:0@lo:103: 00000100:00100000:1.0:1782756125.712323:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756125.712338:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782756125.712342:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b46d8152 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222569728:0@lo:103: 00000100:00100000:1.0:1782756125.712360:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756125.712385:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222569472 00000100:00100000:1.0:1782756125.712389:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222569472 00010000:00010000:1.0:1782756125.712417:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000047e43915/0x5e4fb0a8aa19897c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198975 expref: 12 pid: 5796 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756125.712431:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222569600 00000100:00100000:1.0:1782756125.712434:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222569600 00010000:00010000:1.0:1782756125.712450:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d9467ed8/0x5e4fb0a8aa19890c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198905 expref: 13 pid: 5797 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756125.712461:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222569728 00000100:00100000:1.0:1782756125.712464:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222569728 00010000:00010000:1.0:1782756125.712472:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009906f227/0x5e4fb0a8aa1988f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa1988e9 expref: 14 pid: 5796 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756125.712482:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782756125.712487:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b49d93cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:3315:x1869355222569472:12345-0@lo:103: 00010000:00010000:1.0:1782756125.712496:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756125.712500:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000047e43915/0x5e4fb0a8aa19897c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198975 expref: 14 pid: 5796 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.712509:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000047e43915/0x5e4fb0a8aa19897c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198975 expref: 14 pid: 5796 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.712520:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000047e43915/0x5e4fb0a8aa19897c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa198975 expref: 14 pid: 5796 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.712532:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782756125.712557:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b49d93cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:3315:x1869355222569472:12345-0@lo:103: Request processed in 70us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756125.712563:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782756125.712573:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782756125.712578:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b4f01cba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:3316:x1869355222569600:12345-0@lo:103: 00010000:00010000:1.0:1782756125.712584:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756125.712587:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d9467ed8/0x5e4fb0a8aa19890c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198905 expref: 12 pid: 5797 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.712603:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d9467ed8/0x5e4fb0a8aa19890c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198905 expref: 12 pid: 5797 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.712612:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d9467ed8/0x5e4fb0a8aa19890c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa198905 expref: 12 pid: 5797 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.712621:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782756125.712643:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b4f01cba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:3316:x1869355222569600:12345-0@lo:103: Request processed in 66us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756125.712648:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782756125.712766:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002c450568 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1869355222569344:0@lo:104: 00010000:00010000:3.0:1782756125.712788:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000000a453569/0x5e4fb0a8aa1989c9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756125.712868:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756125.712908:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782756125.712914:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf2d2015 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+10:3316:x1869355222569728:12345-0@lo:103: 00010000:00010000:1.0:1782756125.712921:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756125.712924:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009906f227/0x5e4fb0a8aa1988f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa1988e9 expref: 10 pid: 5796 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.712932:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009906f227/0x5e4fb0a8aa1988f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa1988e9 expref: 10 pid: 5796 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.712941:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009906f227/0x5e4fb0a8aa1988f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa1988e9 expref: 10 pid: 5796 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.712950:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000000a453569/0x5e4fb0a8aa1989c9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.712957:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000a453569/0x5e4fb0a8aa1989c9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.712968:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000a453569/0x5e4fb0a8aa1989c9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.712987:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000a453569/0x5e4fb0a8aa1989c9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.712993:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000a453569/0x5e4fb0a8aa1989c9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.712998:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000a453569/0x5e4fb0a8aa1989c9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.713003:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000a453569 already unused, calling callback (000000002fba626f) 00010000:00010000:1.0:1782756125.713006:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000a453569/0x5e4fb0a8aa1989c9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.713012:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000a453569/0x5e4fb0a8aa1989c9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756125.713156:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005fc4af82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0daec403-69b6-4c98-a0ea-f519ca0a480f:3315:1869355222569472:0@lo:103: 00000100:00100000:0.0:1782756125.713235:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e3292d8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222569600:0@lo:103: 00010000:00010000:3.0:1782756125.713449:0:5796:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000000a453569/0x5e4fb0a8aa1989c9 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.713456:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000a453569/0x5e4fb0a8aa1989c9 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1782756125.713462:0:5796:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:1.0:1782756125.713537:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000a453569/0x5e4fb0a8aa1989c9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.713544:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000a453569/0x5e4fb0a8aa1989c9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.713556:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782756125.713621:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf2d2015 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+9:3316:x1869355222569728:12345-0@lo:103: Request processed in 707us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756125.713627:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782756125.714423:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b46d8152 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222569728:0@lo:103: 00000100:00100000:0.0:1782756125.760959:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c86ece3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+8:6600:x1869355222568960:12345-0@lo:253: Request processed in 58023us (58335us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756125.760987:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782756125.761265:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000adafb731 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222568960:0@lo:253: 10000000:01000000:3.0:1782756125.761281:0:6600:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1782756125.761285:0:6600:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782756125.761286:0:6600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782756125.761288:0:6600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782756125.761289:0:6600:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1782756125.761306:0:6600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782756125.761308:0:6600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782756125.761309:0:6600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782756125.761310:0:6600:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1782756125.761312:0:6600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782756125.761313:0:6600:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782756125.761331:0:6600:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006dd0947c from lustre-OST0000 10000000:01000000:3.0:1782756125.761353:0:6600:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1782756125.761356:0:6600:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1782756125.761363:0:6600:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d3c4aba3380 local copy 10000000:01000000:3.0:1782756125.761366:0:6600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782756125.761402:0:6600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: 00000000ec8f52d7/0x5e4fb0a8aa1989d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.761413:0:6600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.125@tcp lock: 00000000ec8f52d7/0x5e4fb0a8aa1989d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.761422:0:6600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: 00000000ec8f52d7/0x5e4fb0a8aa1989d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756125.761443:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002c450568 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222569856:0@lo:101: 00000100:00100000:3.0:1782756125.761482:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756125.761575:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set 0000000012c27c6c going to sleep for 11 seconds 00000100:00100000:0.0:1782756125.761648:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222569856 00000100:00100000:0.0:1782756125.761654:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222569856 00000100:00100000:0.0:1782756125.761735:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782756125.761744:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074695855 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+8:6600:x1869355222569856:12345-0@lo:101: 00010000:00010000:0.0:1782756125.761757:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756125.761769:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000047e43915/0x5e4fb0a8aa1989d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa1989d0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756125.761790:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000047e43915/0x5e4fb0a8aa1989d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa1989d0 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756125.761799:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000047e43915/0x5e4fb0a8aa1989d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa1989d0 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756125.761808:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000047e43915, rc 0) 00000100:00100000:0.0:1782756125.761967:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074695855 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+9:6600:x1869355222569856:12345-0@lo:101: Request processed in 224us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756125.761995:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782756125.762064:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002c450568 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222569856:0@lo:101: 00010000:00010000:3.0:1782756125.762099:0:6600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: 00000000ec8f52d7/0x5e4fb0a8aa1989d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5e4fb0a8aa1989d7 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.762107:0:6600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: 00000000ec8f52d7/0x5e4fb0a8aa1989d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5e4fb0a8aa1989d7 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756125.762208:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002c450568 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222569984:0@lo:501: 00000100:00100000:3.0:1782756125.762247:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756125.762457:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set 0000000012c27c6c going to sleep for 11 seconds 00000100:00100000:1.0:1782756125.762493:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222569984 00000100:00100000:1.0:1782756125.762501:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222569984 00000100:00100000:1.0:1782756125.762529:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782756125.762535:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003537ff8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+9:6600:x1869355222569984:12345-0@lo:501: 00000100:00100000:1.0:1782756125.762742:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003537ff8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+9:6600:x1869355222569984:12345-0@lo:501: Request processed in 207us (494us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782756125.762750:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782756125.762859:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002c450568 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222569984:0@lo:501: 10000000:01000000:3.0:1782756125.762884:0:6600:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1782756125.762913:0:6600:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1782756125.762919:0:6600:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: 00000000ec8f52d7/0x5e4fb0a8aa1989d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5e4fb0a8aa1989d7 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.762927:0:6600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: 00000000ec8f52d7/0x5e4fb0a8aa1989d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5e4fb0a8aa1989d7 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.762933:0:6600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.125@tcp lock: 00000000ec8f52d7/0x5e4fb0a8aa1989d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5e4fb0a8aa1989d7 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.762954:0:6600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782756125.762980:0:6600:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d3c4a734800 10000000:01000000:3.0:1782756125.762986:0:6600:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782756125.762990:0:6600:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9d3c4aba3380 10000000:01000000:3.0:1782756125.762993:0:6600:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1782756125.762996:0:6600:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9d3c4aba3380 from 1 10000000:01000000:3.0:1782756125.762998:0:6600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782756125.763017:0:6600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: 00000000b449b59d/0x5e4fb0a8aa1989de lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.763024:0:6600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: 00000000b449b59d/0x5e4fb0a8aa1989de lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.763031:0:6600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: 00000000b449b59d/0x5e4fb0a8aa1989de lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756125.763043:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002c450568 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222570112:0@lo:101: 00000100:00100000:3.0:1782756125.763092:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756125.763125:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f19d3eb6 going to sleep for 11 seconds 00000100:00100000:3.0:1782756125.763140:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222570112 00000100:00100000:3.0:1782756125.763144:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222570112 00000100:00100000:3.0:1782756125.763162:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782756125.763168:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d9ab47f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+9:6600:x1869355222570112:12345-0@lo:101: 00010000:00010000:3.0:1782756125.763175:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756125.763185:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e1dbe6d6/0x5e4fb0a8aa1989e5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa1989de expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.763203:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e1dbe6d6/0x5e4fb0a8aa1989e5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa1989de expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.763211:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e1dbe6d6/0x5e4fb0a8aa1989e5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa1989de expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.763219:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e1dbe6d6, rc 0) 00000100:00100000:3.0:1782756125.763388:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d9ab47f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+10:6600:x1869355222570112:12345-0@lo:101: Request processed in 219us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756125.763394:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1782756125.763444:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782756125.763449:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: 00000000ec8f52d7/0x5e4fb0a8aa1989d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5e4fb0a8aa1989d7 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.763456:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ec8f52d7 already unused, calling callback (000000005568db5d) 10000000:00010000:1.0:1782756125.763459:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: 00000000ec8f52d7/0x5e4fb0a8aa1989d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5e4fb0a8aa1989d7 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.763467:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: 00000000ec8f52d7/0x5e4fb0a8aa1989d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x5e4fb0a8aa1989d7 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782756125.763472:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: 00000000ec8f52d7/0x5e4fb0a8aa1989d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x5e4fb0a8aa1989d7 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756125.763477:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782756125.763494:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: 00000000ec8f52d7/0x5e4fb0a8aa1989d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5e4fb0a8aa1989d7 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.763500:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782756125.763521:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: 00000000ec8f52d7/0x5e4fb0a8aa1989d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5e4fb0a8aa1989d7 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.763527:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: 00000000ec8f52d7/0x5e4fb0a8aa1989d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5e4fb0a8aa1989d7 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.763542:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756125.763544:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756125.763551:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756125.763562:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000175fe8ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0daec403-69b6-4c98-a0ea-f519ca0a480f:3314:1869355222570240:0@lo:103: 00000100:00100000:1.0:1782756125.763590:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756125.763674:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002c450568 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222570112:0@lo:101: 00010000:00010000:3.0:1782756125.763685:0:6600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: 00000000b449b59d/0x5e4fb0a8aa1989de lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa1989e5 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.763693:0:6600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: 00000000b449b59d/0x5e4fb0a8aa1989de lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa1989e5 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782756125.763709:0:6600:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782756125.763724:0:6600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: 00000000b449b59d/0x5e4fb0a8aa1989de lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa1989e5 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.763737:0:6600:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: 00000000b449b59d/0x5e4fb0a8aa1989de lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa1989e5 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782756125.763744:0:6600:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1782756125.763747:0:6600:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782756125.763752:0:6600:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1782756125.763753:0:6600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1782756125.763768:0:6600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: 000000006ebb4469/0x5e4fb0a8aa1989ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.763774:0:6600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: 000000006ebb4469/0x5e4fb0a8aa1989ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.763779:0:6600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: 000000006ebb4469/0x5e4fb0a8aa1989ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756125.763798:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002c450568 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222570368:0@lo:101: 00000100:00100000:3.0:1782756125.763889:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756125.763906:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f19d3eb6 going to sleep for 11 seconds 00000100:00100000:3.0:1782756125.763919:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222570368 00000100:00100000:3.0:1782756125.763922:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222570368 00000100:00100000:3.0:1782756125.763940:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782756125.763945:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fbae36af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+10:6600:x1869355222570368:12345-0@lo:101: 00010000:00010000:3.0:1782756125.763952:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756125.763961:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000a453569/0x5e4fb0a8aa1989f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa1989ec expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.763984:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000a453569/0x5e4fb0a8aa1989f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa1989ec expref: 11 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.763998:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000a453569/0x5e4fb0a8aa1989f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa1989ec expref: 11 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.764003:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000a453569, rc 0) 00000100:00100000:3.0:1782756125.764031:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fbae36af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:6600:x1869355222570368:12345-0@lo:101: Request processed in 86us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756125.764036:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782756125.764100:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002c450568 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222570368:0@lo:101: 00010000:00010000:3.0:1782756125.764184:0:6600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: 000000006ebb4469/0x5e4fb0a8aa1989ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa1989f3 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.764192:0:6600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: 000000006ebb4469/0x5e4fb0a8aa1989ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa1989f3 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756125.764284:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002c450568 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222570496:0@lo:501: 00000100:00100000:3.0:1782756125.764399:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756125.764419:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f19d3eb6 going to sleep for 11 seconds 00000100:00100000:3.0:1782756125.764431:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222570496 00000100:00100000:3.0:1782756125.764435:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222570496 00000100:00100000:3.0:1782756125.764450:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782756125.764455:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a3a8eb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:6600:x1869355222570496:12345-0@lo:501: 00000100:00100000:3.0:1782756125.764646:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a3a8eb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:6600:x1869355222570496:12345-0@lo:501: Request processed in 190us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756125.764652:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782756125.764685:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002c450568 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222570496:0@lo:501: 00000100:00100000:3.0:1782756125.764710:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002c450568 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222570624:0@lo:503: 00000100:00100000:3.0:1782756125.764749:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756125.764762:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f19d3eb6 going to sleep for 11 seconds 00000100:00100000:3.0:1782756125.764775:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222570624 00000100:00100000:3.0:1782756125.764779:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222570624 00000100:00100000:3.0:1782756125.764793:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782756125.764798:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000090556fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:6600:x1869355222570624:12345-0@lo:503: 00000100:00100000:3.0:1782756125.765333:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000090556fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:6600:x1869355222570624:12345-0@lo:503: Request processed in 533us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756125.765340:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782756125.765426:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002c450568 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222570624:0@lo:503: 00000040:00080000:1.0:1782756125.765695:0:6600:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782756125.765754:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000813db081 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222570752:0@lo:502: 00000100:00100000:1.0:1782756125.765795:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756125.765943:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e7f705a5 going to sleep for 11 seconds 00000100:00100000:3.0:1782756125.766004:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222570752 00000100:00100000:3.0:1782756125.766008:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222570752 00000100:00100000:3.0:1782756125.766034:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782756125.766039:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d24e22f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:6600:x1869355222570752:12345-0@lo:502: 00000100:00100000:3.0:1782756125.767351:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d24e22f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:6600:x1869355222570752:12345-0@lo:502: Request processed in 1306us (1551us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756125.767362:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782756125.767508:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000813db081 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222570752:0@lo:502: 00000040:00080000:1.0:1782756125.767819:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000100:00100000:3.0:1782756125.768220:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222570240 00000100:00100000:3.0:1782756125.768227:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222570240 00000100:00100000:3.0:1782756125.768268:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782756125.768274:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d49fc81c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:3314:x1869355222570240:12345-0@lo:103: 00010000:00010000:3.0:1782756125.768286:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756125.768302:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000047e43915/0x5e4fb0a8aa1989d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5e4fb0a8aa1989d0 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.768319:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782756125.768360:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d49fc81c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+10:3314:x1869355222570240:12345-0@lo:103: Request processed in 86us (4770us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756125.768366:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782756125.768403:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000175fe8ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0daec403-69b6-4c98-a0ea-f519ca0a480f:3314:1869355222570240:0@lo:103: 00000040:00080000:1.0:1782756125.768624:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1782756125.768660:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1782756125.768813:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1782756125.768999:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1782756125.769035:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1782756125.769070:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000813db081 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222570880:0@lo:502: 00000100:00100000:1.0:1782756125.769279:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756125.769350:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e7f705a5 going to sleep for 11 seconds 00000100:00100000:3.0:1782756125.769391:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222570880 00000100:00100000:3.0:1782756125.769397:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222570880 00000100:00100000:3.0:1782756125.769462:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782756125.769469:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be3d1ab2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+10:6600:x1869355222570880:12345-0@lo:502: 00000100:00100000:3.0:1782756125.769667:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be3d1ab2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+10:6600:x1869355222570880:12345-0@lo:502: Request processed in 198us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756125.769674:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782756125.769762:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000813db081 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222570880:0@lo:502: 00000040:00080000:1.0:1782756125.769883:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1782756125.769893:0:6600:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1782756125.772473:0:6618:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782756125.772485:0:6618:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1782756125.772497:0:6618:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756125.772505:0:6618:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1782756125.772513:0:6618:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782756125.772528:0:6618:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (00000000dda65ab9) 00000020:00000080:2.0:1782756125.772551:0:6618:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1782756125.772558:0:6618:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1782756125.772636:0:6618:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006dd0947c from lustre-OST0000, refs=2 00080000:01000000:2.0:1782756125.772643:0:6618:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782756125.772650:0:6618:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5e4fb0a8aa198a01 00010000:00010000:2.0:1782756125.787997:0:6618:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1782756125.788380:0:6618:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1782756125.795269:0:6618:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1782756125.796592:0:6618:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1782756125.809674:0:6618:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1782756125.810873:0:6618:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1782756125.813651:0:6618:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1782756125.813662:0:6618:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782756125.813668:0:6618:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782756125.813670:0:6618:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1782756125.813674:0:6618:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782756125.813678:0:6618:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782756125.813679:0:6618:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782756125.813684:0:6618:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782756125.813686:0:6618:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1782756125.813748:0:6618:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782756125.813752:0:6618:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782756125.813754:0:6618:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782756125.813938:0:6618:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1782756125.814220:0:6600:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1782756125.814269:0:6600:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1782756125.814295:0:6600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: 000000006ebb4469/0x5e4fb0a8aa1989ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa1989f3 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.814309:0:6600:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: 000000006ebb4469/0x5e4fb0a8aa1989ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa1989f3 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782756125.814316:0:6600:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9d3c4a734800 from 1 10000000:01000000:3.0:1782756125.814319:0:6600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782756125.814355:0:6600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: 000000009906f227/0x5e4fb0a8aa198a08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.814363:0:6600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: 000000009906f227/0x5e4fb0a8aa198a08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.814382:0:6600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: 000000009906f227/0x5e4fb0a8aa198a08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756125.814418:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bf149440 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222571008:0@lo:101: 00000100:00100000:3.0:1782756125.814663:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756125.814717:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set 00000000fe3c4ccd going to sleep for 11 seconds 00000100:00100000:2.0:1782756125.814724:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222571008 00000100:00100000:2.0:1782756125.814733:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222571008 00000100:00100000:2.0:1782756125.814805:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782756125.814815:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030460a93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+10:6600:x1869355222571008:12345-0@lo:101: 00010000:00010000:2.0:1782756125.814830:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756125.814846:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000088088607/0x5e4fb0a8aa198a0f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198a08 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756125.814870:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000088088607/0x5e4fb0a8aa198a0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198a08 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756125.814895:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000088088607/0x5e4fb0a8aa198a0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198a08 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756125.814904:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000088088607, rc 0) 00000100:00100000:2.0:1782756125.814958:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030460a93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:6600:x1869355222571008:12345-0@lo:101: Request processed in 145us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756125.814965:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782756125.815011:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bf149440 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222571008:0@lo:101: 00010000:00010000:3.0:1782756125.815025:0:6600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: 000000009906f227/0x5e4fb0a8aa198a08 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198a0f expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.815033:0:6600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: 000000009906f227/0x5e4fb0a8aa198a08 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198a0f expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756125.815249:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bf149440 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222571136:0@lo:501: 00000100:00100000:3.0:1782756125.815279:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756125.815481:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222571136 00000100:00100000:2.0:1782756125.815487:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222571136 00000100:00100000:3.0:1782756125.815551:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set 00000000fe3c4ccd going to sleep for 11 seconds 00000100:00100000:2.0:1782756125.815737:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1782756125.815746:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea9ecef1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:6600:x1869355222571136:12345-0@lo:501: 00000100:00100000:2.0:1782756125.818037:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea9ecef1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:6600:x1869355222571136:12345-0@lo:501: Request processed in 2285us (2749us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756125.818051:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1782756125.821321:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bf149440 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222571136:0@lo:501: 00000100:00100000:3.0:1782756125.821442:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bf149440 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222571264:0@lo:503: 00000100:00100000:3.0:1782756125.821525:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756125.821572:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b9b8ceec going to sleep for 11 seconds 00000100:00100000:2.0:1782756125.821621:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222571264 00000100:00100000:2.0:1782756125.821629:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222571264 00000100:00100000:2.0:1782756125.821684:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782756125.821693:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf7bd8e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:6600:x1869355222571264:12345-0@lo:503: 00000100:00100000:2.0:1782756125.822271:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf7bd8e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:6600:x1869355222571264:12345-0@lo:503: Request processed in 578us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756125.822282:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782756125.822469:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bf149440 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222571264:0@lo:503: 00000040:00080000:3.0:1782756125.822772:0:6600:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782756125.822847:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bf149440 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222571392:0@lo:502: 00000100:00100000:3.0:1782756125.822891:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756125.822931:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b9b8ceec going to sleep for 11 seconds 00000100:00100000:0.0:1782756125.823024:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222571392 00000100:00100000:0.0:1782756125.823030:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222571392 00000100:00100000:0.0:1782756125.823060:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782756125.823067:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000242b6b61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:6600:x1869355222571392:12345-0@lo:502: 00000100:00100000:0.0:1782756125.823339:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000242b6b61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:6600:x1869355222571392:12345-0@lo:502: Request processed in 272us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756125.823347:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782756125.824246:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bf149440 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222571392:0@lo:502: 00000040:00080000:0.0:1782756125.824631:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1782756125.824705:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1782756125.824746:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000966bdd96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222571520:0@lo:502: 00000100:00100000:0.0:1782756125.824799:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756125.824826:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set 000000004e776547 going to sleep for 11 seconds 00000100:00100000:2.0:1782756125.824886:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222571520 00000100:00100000:2.0:1782756125.824893:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222571520 00000100:00100000:2.0:1782756125.824934:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782756125.824943:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081878c60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:6600:x1869355222571520:12345-0@lo:502: 00000100:00100000:2.0:1782756125.825270:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081878c60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:6600:x1869355222571520:12345-0@lo:502: Request processed in 329us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756125.825278:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782756125.826524:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000966bdd96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222571520:0@lo:502: 00000040:00080000:0.0:1782756125.826671:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1782756125.826685:0:6600:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1782756125.827616:0:6622:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782756125.827626:0:6622:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782756125.827629:0:6622:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1782756125.827635:0:6622:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d3c4a734800 00000020:00000080:0.0:1782756125.827637:0:6622:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782756125.827666:0:6622:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782756125.827669:0:6622:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782756125.827670:0:6622:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1782756125.827673:0:6622:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1782756125.827791:0:6600:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1782756125.827832:0:6600:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782756125.827881:0:6600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4168c400/0x5e4fb0a8aa198a08 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198a0f expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.827893:0:6600:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c4168c400/0x5e4fb0a8aa198a08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198a0f expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756125.827939:0:6600:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782756125.827943:0:6600:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d3c4a734800 10000000:01000000:1.0:1782756125.827946:0:6600:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d3c4a734800 10000000:01000000:1.0:1782756125.827950:0:6600:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782756125.827955:0:6600:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9d3c4a734800 from 1 10000000:01000000:1.0:1782756125.827958:0:6600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782756125.828000:0:6600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41497000/0x5e4fb0a8aa198a16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.828009:0:6600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c41497000/0x5e4fb0a8aa198a16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.828019:0:6600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c41497000/0x5e4fb0a8aa198a16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756125.828038:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222571648:0@lo:101: 00000100:00100000:1.0:1782756125.828797:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756125.828892:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c48368cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782756125.828928:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222571648 00000100:00100000:0.0:1782756125.828934:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222571648 00000100:00100000:0.0:1782756125.829012:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782756125.829022:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:6600:x1869355222571648:12345-0@lo:101: 00010000:00010000:0.0:1782756125.829036:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756125.829049:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c40031c00/0x5e4fb0a8aa198a1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198a16 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756125.829099:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c40031c00/0x5e4fb0a8aa198a1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198a16 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756125.829119:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c40031c00/0x5e4fb0a8aa198a1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198a16 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756125.829129:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c40031c00, rc 0) 00000100:00100000:0.0:1782756125.829166:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:6600:x1869355222571648:12345-0@lo:101: Request processed in 146us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756125.829173:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782756125.829280:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222571648:0@lo:101: 00010000:00010000:1.0:1782756125.829294:0:6600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c41497000/0x5e4fb0a8aa198a16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198a1d expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.829303:0:6600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c41497000/0x5e4fb0a8aa198a16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198a1d expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756125.829394:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222571776:0@lo:501: 00000100:00100000:1.0:1782756125.829418:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756125.829657:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c48368cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782756125.829702:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222571776 00000100:00100000:2.0:1782756125.829706:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222571776 00000100:00100000:3.0:1782756125.829771:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782756125.829780:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:6600:x1869355222571776:12345-0@lo:501: 00000100:00100000:3.0:1782756125.830043:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:6600:x1869355222571776:12345-0@lo:501: Request processed in 264us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756125.830055:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782756125.830121:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222571776:0@lo:501: 00000100:00100000:1.0:1782756125.830144:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222571904:0@lo:503: 00000100:00100000:1.0:1782756125.830173:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756125.830273:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c48368cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782756125.830309:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222571904 00000100:00100000:3.0:1782756125.830312:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222571904 00000100:00100000:3.0:1782756125.830341:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782756125.830421:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:6600:x1869355222571904:12345-0@lo:503: 00000100:00100000:3.0:1782756125.830582:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:6600:x1869355222571904:12345-0@lo:503: Request processed in 235us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756125.830589:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782756125.830611:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222571904:0@lo:503: 00000040:00080000:1.0:1782756125.830852:0:6600:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782756125.830921:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222572032:0@lo:502: 00000100:00100000:1.0:1782756125.830954:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756125.830984:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c48368cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782756125.831023:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222572032 00000100:00100000:3.0:1782756125.831028:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222572032 00000100:00100000:3.0:1782756125.831059:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782756125.831066:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:6600:x1869355222572032:12345-0@lo:502: 00000100:00100000:1.0:1782756125.831389:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222572032:0@lo:502: 00000100:00100000:3.0:1782756125.831442:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:6600:x1869355222572032:12345-0@lo:502: Request processed in 281us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756125.831450:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000040:00080000:1.0:1782756125.831661:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1782756125.831709:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1782756125.831760:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1782756125.831813:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1782756125.831858:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1782756125.831907:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1782756125.831945:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1782756125.832007:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1782756125.832059:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1782756125.832122:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1782756125.832158:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1782756125.832293:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1782756125.832336:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1782756125.832370:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1782756125.832420:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1782756125.832456:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1782756125.832492:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1782756125.832558:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1782756125.832604:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1782756125.832637:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1782756125.832685:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1782756125.832712:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1782756125.832746:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1782756125.832772:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1782756125.832791:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1782756125.832807:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1782756125.832830:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1782756125.832847:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1782756125.832874:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222572160:0@lo:502: 00000100:00100000:1.0:1782756125.832924:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756125.833002:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222572160 00000100:00100000:3.0:1782756125.833008:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222572160 00000100:00100000:1.0:1782756125.833019:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c48368cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782756125.833046:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782756125.833054:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:6600:x1869355222572160:12345-0@lo:502: 00000100:00100000:3.0:1782756125.833276:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:6600:x1869355222572160:12345-0@lo:502: Request processed in 222us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756125.833284:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782756125.833336:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222572160:0@lo:502: 00000040:00080000:1.0:1782756125.833492:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1782756125.833499:0:6600:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1782756125.838422:0:6623:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1782756125.838439:0:6623:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9d3c50023380) 00000020:00000080:3.0:1782756125.838460:0:6623:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1782756125.838646:0:6623:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3c4a734800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1782756125.838650:0:6623:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d3c4a734800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1782756125.838658:0:6623:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9d3c4a734800 3 00010000:00080000:3.0:1782756125.838686:0:6623:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3b4114c800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.125@tcp at head 00010000:00010000:3.0:1782756125.840927:0:6623:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1782756125.841523:0:6623:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1782756125.841629:0:6623:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782756125.841646:0:6623:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5e4fb0a8aa198a2b 00000100:00080000:3.0:1782756125.841658:0:6623:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782756125.841665:0:6623:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d3b4114c800 using connection 192.168.204.125@tcp/0@lo 00000100:00100000:3.0:1782756125.841700:0:6623:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3c78a33100 x1869355222572288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782756125.841775:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1869355222572288:0@lo:38: 00000100:00100000:0.0:1782756125.841857:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782756125.842015:0:6623:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1782756125.842155:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782756125.842165:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b604000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869355222572416:0@lo:400: 00000100:00100000:2.0:1782756125.842198:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1782756125.842547:0:6623:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1782756125.842619:0:6600:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1782756125.842671:0:6600:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782756125.842753:0:6600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41497000/0x5e4fb0a8aa198a16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198a1d expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.842765:0:6600:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c41497000/0x5e4fb0a8aa198a16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198a1d expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1782756125.842812:0:6600:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1782756125.842815:0:6600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782756125.842816:0:6600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782756125.842817:0:6600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782756125.842818:0:6600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782756125.842820:0:6600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782756125.842821:0:6600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782756125.842823:0:6600:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782756125.842828:0:6600:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782756125.842829:0:6600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782756125.842830:0:6600:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782756125.842834:0:6600:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1782756125.842837:0:6600:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782756125.842838:0:6600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782756125.842839:0:6600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782756125.842839:0:6600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782756125.842840:0:6600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782756125.842841:0:6600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782756125.842842:0:6600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782756125.842843:0:6600:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782756125.842844:0:6600:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782756125.842844:0:6600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782756125.842845:0:6600:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782756125.842861:0:6600:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1782756125.842872:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222572544:0@lo:253: 00000100:00100000:1.0:1782756125.842912:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756125.842931:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c48368900 going to sleep for 11 seconds 00000100:00100000:1.0:1782756125.842950:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222572544 00000100:00100000:1.0:1782756125.842957:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222572544 00000100:00100000:1.0:1782756125.843007:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782756125.843015:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:6600:x1869355222572544:12345-0@lo:253: 20000000:01000000:1.0:1782756125.843056:0:5797:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1782756125.843070:0:5797:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1782756125.843247:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222572288 00000100:00100000:0.0:1782756125.843252:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222572288 00000100:00100000:0.0:1782756125.843310:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222572416 00000100:00100000:0.0:1782756125.843315:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222572416 00000100:00100000:2.0:1782756125.843426:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782756125.843436:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4b605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869355222572416:12345-0@lo:400: 00000100:00100000:2.0:1782756125.843505:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4b605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869355222572416:12345-0@lo:400: Request processed in 69us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756125.843513:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782756125.843530:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782756125.843535:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c809f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3313:x1869355222572288:12345-0@lo:38: 00010000:00080000:2.0:1782756125.843554:0:5804:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:2.0:1782756125.843646:0:5804:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5e4fb0a8aa198a32 00000004:00100000:2.0:1782756125.843662:0:5804:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782756125.843690:0:5804:0:(import.c:65:import_set_state_nolock()) ffff9d3c7fc67000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782756125.843737:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c809f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869355222572288:12345-0@lo:38: Request processed in 201us (1881us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756125.843745:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1782756125.843780:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d3c4b604000 x1869355222572416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782756141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782756125.843794:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b604000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869355222572416:0@lo:400: 00010000:00080000:3.0:1782756125.843889:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d3c78a33100 x1869355222572288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782756135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756125.843905:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782756125.843914:0:3313:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1782756125.843921:0:3313:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1782756125.843926:0:3313:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1782756125.843929:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9d3b4114c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1782756125.843934:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1869355222572288:0@lo:38: 20000000:01000000:0.0:1782756125.878988:0:5797:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1782756125.879048:0:5797:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1782756125.879230:0:5819:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1782756125.879235:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1782756125.879269:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198a39 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.879290:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa19899f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198998 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.879321:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198a39 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.879365:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa19899f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa198998 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.879381:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa19899f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198998 expref: 12 pid: 5797 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756125.879395:0:5819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78a33100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5819:1869355222572672:0@lo:104: 00000100:00100000:3.0:1782756125.879479:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756125.879645:0:5819:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c46826900 going to sleep for 11 seconds 00000100:00100000:1.0:1782756125.882072:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222572672 00000100:00100000:1.0:1782756125.882098:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222572672 00000100:00100000:1.0:1782756125.882154:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782756125.882164:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78a32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+3:5819:x1869355222572672:12345-0@lo:104: 00010000:00010000:1.0:1782756125.882192:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: ffff9d3c41531a00/0x5e4fb0a8aa198998 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa19899f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756125.882282:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782756125.882289:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78a32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+3:5819:x1869355222572672:12345-0@lo:104: Request processed in 127us (2810us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756125.882309:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782756125.882319:0:5819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78a33100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5819:1869355222572672:0@lo:104: 00010000:00010000:3.0:1782756125.882341:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198a39 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756125.882428:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782756125.882436:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c41531a00/0x5e4fb0a8aa198998 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa19899f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756125.882445:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41531a00 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:0.0:1782756125.882448:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41531a00/0x5e4fb0a8aa198998 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa19899f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756125.882457:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c41531a00/0x5e4fb0a8aa198998 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa19899f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782756125.882465:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41531a00/0x5e4fb0a8aa198998 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa19899f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782756125.882471:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782756125.882519:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c41531a00/0x5e4fb0a8aa198998 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa19899f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756125.882527:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782756125.882558:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c41531a00/0x5e4fb0a8aa198998 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa19899f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756125.882566:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c41531a00/0x5e4fb0a8aa198998 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa19899f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756125.882582:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782756125.882593:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222572800:0@lo:103: 00010000:00010000:0.0:1782756125.882594:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756125.882596:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756125.882598:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782756125.882632:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756125.882765:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222572800 00000100:00100000:0.0:1782756125.882770:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222572800 00010000:00010000:0.0:1782756125.882796:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa19899f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198998 expref: 13 pid: 5797 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756125.882828:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782756125.882836:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aa1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:3317:x1869355222572800:12345-0@lo:103: 00010000:00010000:0.0:1782756125.882847:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756125.882853:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa19899f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198998 expref: 13 pid: 5797 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756125.882866:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa19899f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198998 expref: 13 pid: 5797 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756125.882881:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa19899f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa198998 expref: 13 pid: 5797 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756125.882897:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198a39 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756125.882907:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198a39 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782756125.882922:0:5790:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003687192s 00010000:00010000:0.0:1782756125.882927:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198a39 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756125.882945:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198a39 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756125.882952:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198a39 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756125.882958:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198a39 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756125.882963:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168d200 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:0.0:1782756125.882977:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198a39 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756125.882984:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198a39 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756125.882997:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198a39 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756125.883008:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756125.883039:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aa1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:3317:x1869355222572800:12345-0@lo:103: Request processed in 205us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756125.883046:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782756125.883156:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222572800:0@lo:103: 00010000:00010000:3.0:1782756125.883177:0:5819:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198a39 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.883187:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198a39 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756125.883194:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198a39 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756125.885964:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:6600:x1869355222572544:12345-0@lo:253: Request processed in 42942us (43044us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756125.885986:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782756125.886426:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:6600:1869355222572544:0@lo:253: 10000000:01000000:2.0:1782756125.886443:0:6600:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1782756125.886446:0:6600:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782756125.886448:0:6600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782756125.886449:0:6600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782756125.886450:0:6600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782756125.886452:0:6600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782756125.886453:0:6600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782756125.886454:0:6600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782756125.886456:0:6600:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782756125.886457:0:6600:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782756125.886459:0:6600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782756125.886460:0:6600:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782756125.886474:0:6600:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1782756125.893773:0:6600:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1782756125.894745:0:6600:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1782756125.895749:0:6600:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1782756125.896907:0:6600:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1782756125.897821:0:6600:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1782756125.898177:0:6600:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1782756125.903149:0:6600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1782756126.050715:0:6600:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1782756126.050721:0:6600:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1782756126.050840:0:6600:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1782756126.050978:0:6600:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.125@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1782756126.050998:0:6600:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1782756126.051026:0:6600:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1782756126.157295:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756127.181495:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756128.205050:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782756128.268225:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782756128.268233:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9d3c4505a800 from 21 10000000:01000000:2.0:1782756128.268238:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782756128.268281:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41530800/0x5e4fb0a8aa198a40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756128.268294:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c41530800/0x5e4fb0a8aa198a40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756128.268305:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c41530800/0x5e4fb0a8aa198a40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756128.268330:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222572928:0@lo:101: 00000100:00100000:2.0:1782756128.268392:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756128.268440:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a143600 going to sleep for 11 seconds 00000100:00100000:3.0:1782756128.268504:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222572928 00000100:00100000:3.0:1782756128.268511:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222572928 00000100:00100000:3.0:1782756128.268574:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782756128.268584:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:5800:x1869355222572928:12345-0@lo:101: 00010000:00010000:3.0:1782756128.268599:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756128.268612:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198a47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198a40 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756128.268635:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198a40 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756128.268646:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198a40 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756128.268655:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168d200, rc 0) 00000100:00100000:3.0:1782756128.268690:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:5800:x1869355222572928:12345-0@lo:101: Request processed in 108us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756128.268707:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782756128.269015:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222572928:0@lo:101: 00010000:00010000:2.0:1782756128.269029:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c41530800/0x5e4fb0a8aa198a40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198a47 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756128.269039:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c41530800/0x5e4fb0a8aa198a40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198a47 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756128.269118:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222573056:0@lo:501: 00000100:00100000:2.0:1782756128.269146:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756128.269170:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a143600 going to sleep for 11 seconds 00000100:00100000:1.0:1782756128.269220:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222573056 00000100:00100000:1.0:1782756128.269225:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222573056 00000100:00100000:1.0:1782756128.269256:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1782756128.269263:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:5800:x1869355222573056:12345-0@lo:501: 00000100:00100000:1.0:1782756128.269669:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:5800:x1869355222573056:12345-0@lo:501: Request processed in 405us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756128.269676:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782756128.269820:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222573056:0@lo:501: 00000100:00100000:2.0:1782756128.269848:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222573184:0@lo:503: 00000100:00100000:2.0:1782756128.269885:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756128.269929:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a143600 going to sleep for 11 seconds 00000100:00100000:1.0:1782756128.270026:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222573184 00000100:00100000:1.0:1782756128.270031:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222573184 00000100:00100000:1.0:1782756128.270064:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1782756128.270071:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:5800:x1869355222573184:12345-0@lo:503: 00000100:00100000:1.0:1782756128.270348:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:5800:x1869355222573184:12345-0@lo:503: Request processed in 276us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756128.270354:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782756128.270436:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222573184:0@lo:503: 00000100:00100000:2.0:1782756128.272598:0:6788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b604000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:6788:1869355222573312:0@lo:502: 00000100:00100000:2.0:1782756128.272662:0:6788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756128.272698:0:6788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a1436c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782756128.272773:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222573312 00000100:00100000:3.0:1782756128.272780:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222573312 00000100:00100000:3.0:1782756128.272825:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782756128.272989:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:6788:x1869355222573312:12345-0@lo:502: 00000100:00100000:0.0:1782756128.273954:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:6788:x1869355222573312:12345-0@lo:502: Request processed in 1118us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756128.273964:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782756128.274300:0:6788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b604000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:6788:1869355222573312:0@lo:502: 00000100:00100000:2.0:1782756128.274363:0:6788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b604000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:6788:1869355222573440:0@lo:502: 00000100:00100000:2.0:1782756128.274402:0:6788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756128.274507:0:6788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a1436c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782756128.274564:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222573440 00000100:00100000:0.0:1782756128.274569:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222573440 00000100:00100000:0.0:1782756128.274605:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782756128.274618:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:6788:x1869355222573440:12345-0@lo:502: 00000100:00100000:0.0:1782756128.274769:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:6788:x1869355222573440:12345-0@lo:502: Request processed in 151us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756128.274776:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782756128.274865:0:6788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b604000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:6788:1869355222573440:0@lo:502: 00000040:00080000:2.0:1782756128.274883:0:6788:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1782756128.275280:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1782756128.275300:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782756128.275310:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41530800/0x5e4fb0a8aa198a40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198a47 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756128.275321:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c41530800/0x5e4fb0a8aa198a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198a47 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782756128.275330:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1782756128.275332:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9d3c4505a800 from 4 10000000:01000000:0.0:1782756128.275335:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782756128.275362:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c40030200/0x5e4fb0a8aa198a4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756128.275370:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c40030200/0x5e4fb0a8aa198a4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756128.275378:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c40030200/0x5e4fb0a8aa198a4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756128.275392:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222573568:0@lo:101: 00000100:00100000:0.0:1782756128.275424:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756128.275443:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c44e430c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782756128.275503:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222573568 00000100:00100000:2.0:1782756128.275514:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222573568 00000100:00100000:2.0:1782756128.275544:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782756128.275551:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:5800:x1869355222573568:12345-0@lo:101: 00010000:00010000:2.0:1782756128.275561:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756128.275574:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c41530200/0x5e4fb0a8aa198a55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198a4e expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756128.275592:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c41530200/0x5e4fb0a8aa198a55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198a4e expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756128.275602:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c41530200/0x5e4fb0a8aa198a55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198a4e expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756128.275610:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41530200, rc 0) 00000100:00100000:2.0:1782756128.275644:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:5800:x1869355222573568:12345-0@lo:101: Request processed in 92us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756128.275657:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782756128.275688:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222573568:0@lo:101: 00010000:00010000:2.0:1782756128.275701:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c40030200/0x5e4fb0a8aa198a4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198a55 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756128.275708:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c40030200/0x5e4fb0a8aa198a4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198a55 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756128.275750:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222573696:0@lo:256: 00000100:00100000:2.0:1782756128.275779:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756128.275792:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a1433c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782756128.275803:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222573696 00000100:00100000:2.0:1782756128.275806:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222573696 00000100:00100000:2.0:1782756128.275823:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782756128.275828:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:5800:x1869355222573696:12345-0@lo:256: 20000000:01000000:2.0:1782756128.275855:0:5796:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1782756128.275869:0:5796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1782756128.275871:0:5796:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1782756128.275948:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:5800:x1869355222573696:12345-0@lo:256: Request processed in 119us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756128.275955:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782756128.275980:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222573696:0@lo:256: 10000000:01000000:2.0:1782756128.276013:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782756128.276018:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c40030200/0x5e4fb0a8aa198a4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198a55 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756128.276025:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c40030200/0x5e4fb0a8aa198a4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198a55 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782756128.276036:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1782756128.276038:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1782756128.276040:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1782756128.276054:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198a5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756128.276061:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198a5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756128.276067:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198a5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756128.276101:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222573824:0@lo:101: 00000100:00100000:2.0:1782756128.276125:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756128.276136:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a1433c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782756128.276146:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222573824 00000100:00100000:2.0:1782756128.276149:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222573824 00000100:00100000:2.0:1782756128.276163:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782756128.276169:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:5800:x1869355222573824:12345-0@lo:101: 00010000:00010000:2.0:1782756128.276175:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756128.276182:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c41530e00/0x5e4fb0a8aa198a63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198a5c expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756128.276194:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c41530e00/0x5e4fb0a8aa198a63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198a5c expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756128.276201:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c41530e00/0x5e4fb0a8aa198a63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198a5c expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756128.276216:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41530e00, rc 0) 00000100:00100000:2.0:1782756128.276240:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:5800:x1869355222573824:12345-0@lo:101: Request processed in 72us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756128.276245:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782756128.276269:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222573824:0@lo:101: 00010000:00010000:2.0:1782756128.276277:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198a5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198a63 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756128.276284:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198a5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198a63 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756128.276316:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222573952:0@lo:501: 00000100:00100000:2.0:1782756128.276335:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756128.276346:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a1433c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782756128.276355:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222573952 00000100:00100000:2.0:1782756128.276358:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222573952 00000100:00100000:2.0:1782756128.276389:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782756128.276396:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:5800:x1869355222573952:12345-0@lo:501: 00000100:00100000:2.0:1782756128.276605:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:5800:x1869355222573952:12345-0@lo:501: Request processed in 209us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756128.276612:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782756128.276640:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222573952:0@lo:501: 00000100:00100000:2.0:1782756128.276662:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222574080:0@lo:503: 00000100:00100000:2.0:1782756128.276693:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756128.276705:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a1433c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782756128.276728:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222574080 00000100:00100000:2.0:1782756128.276731:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222574080 00000100:00100000:2.0:1782756128.276747:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782756128.276752:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:5800:x1869355222574080:12345-0@lo:503: 00000100:00100000:2.0:1782756128.277718:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:5800:x1869355222574080:12345-0@lo:503: Request processed in 962us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756128.277726:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782756128.277874:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222574080:0@lo:503: 00000100:00100000:0.0:1782756128.278343:0:6789:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:6789:1869355222574208:0@lo:502: 00000100:00100000:0.0:1782756128.278385:0:6789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756128.278428:0:6789:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c44e436c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782756128.278481:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222574208 00000100:00100000:1.0:1782756128.278487:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222574208 00000100:00100000:1.0:1782756128.278520:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782756128.278528:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:6789:x1869355222574208:12345-0@lo:502: 00000100:00100000:1.0:1782756128.278750:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:6789:x1869355222574208:12345-0@lo:502: Request processed in 221us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756128.278764:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782756128.278826:0:6789:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:6789:1869355222574208:0@lo:502: 00000020:01000000:3.0:1782756128.278850:0:6789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782756128.278856:0:6789:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1782756128.278862:0:6789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782756128.278865:0:6789:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1782756128.278870:0:6789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1782756128.278874:0:6789:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.125@tcp to nid 0x20000c0a8cc7d (192.168.204.125@tcp) 00000020:01000000:3.0:1782756128.278895:0:6789:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1782756128.278897:0:6789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782756128.278911:0:6789:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9d3c50024d40) 00000020:00000080:3.0:1782756128.278942:0:6789:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1782756128.278949:0:6789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1782756128.279012:0:6789:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1782756128.279018:0:6789:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1782756128.279024:0:6789:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5e4fb0a8aa198a71 00010000:00080000:3.0:1782756128.279051:0:6789:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3b4114f800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.125@tcp at head 00010000:00010000:3.0:1782756128.279355:0:6789:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1782756128.338197:0:6789:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1782756128.338221:0:6789:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1782756128.338803:0:6789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782756128.338982:0:6789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782756128.339023:0:6789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1782756128.339070:0:6789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1782756128.339397:0:6794:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782756128.339402:0:6794:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1782756128.342147:0:6789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782756128.342163:0:6789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1782756128.342203:0:6789:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1782756128.342225:0:6789:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5e4fb0a8aa198a78 00000100:00080000:1.0:1782756128.342236:0:6789:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782756128.342242:0:6789:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d3b4114f800 using connection 192.168.204.125@tcp/0@lo 00000100:00100000:1.0:1782756128.342278:0:6789:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3c78fc2a00 x1869355222574336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782756128.342300:0:6789:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1782756128.342349:0:6789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782756128.342353:0:6789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782756128.342355:0:6789:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1782756128.342358:0:6789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782756128.342361:0:6789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782756128.342363:0:6789:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782756128.342366:0:6789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782756128.342368:0:6789:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1782756128.342394:0:6789:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:6789:1869355222574464:0@lo:502: 00000100:00100000:1.0:1782756128.342487:0:6789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756128.342611:0:6789:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78a50540 going to sleep for 11 seconds 00000100:00100000:1.0:1782756128.342633:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869355222574336:0@lo:8: 00000100:00100000:1.0:1782756128.342666:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756128.342813:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222574464 00000100:00100000:1.0:1782756128.342819:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222574464 00000100:00100000:1.0:1782756128.342853:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782756128.342862:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:6789:x1869355222574464:12345-0@lo:502: 00000100:00100000:1.0:1782756128.343119:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:6789:x1869355222574464:12345-0@lo:502: Request processed in 257us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756128.343133:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782756128.343176:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222574336 00000100:00100000:1.0:1782756128.343180:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222574336 00000100:00100000:1.0:1782756128.343199:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782756128.343203:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1869355222574336:12345-0@lo:8: 00010000:00080000:1.0:1782756128.343222:0:6602:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:1.0:1782756128.343246:0:6602:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5e4fb0a8aa198a7f 00002000:00100000:1.0:1782756128.343275:0:6602:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9d3c4a6fb800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1782756128.343280:0:6602:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1782756128.343284:0:6602:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1782756128.343390:0:6602:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1782756128.343516:0:6602:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782756128.345010:0:6602:0:(import.c:65:import_set_state_nolock()) ffff9d3c4a6f8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782756128.345150:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1869355222574336:12345-0@lo:8: Request processed in 1942us (2480us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756128.345159:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782756128.345195:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869355222574592:0@lo:400: 00000100:00100000:1.0:1782756128.345226:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756128.345274:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222574720:0@lo:400: 00000100:00100000:1.0:1782756128.345298:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756128.345346:0:6789:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:6789:1869355222574464:0@lo:502: 00000020:01000000:1.0:1782756128.345377:0:6789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782756128.345385:0:6789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782756128.345387:0:6789:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1782756128.345391:0:6789:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:1.0:1782756128.345491:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222574592 00000100:00100000:1.0:1782756128.345503:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222574592 00000100:00100000:2.0:1782756128.345627:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222574720 00000100:00100000:2.0:1782756128.345631:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222574720 00000100:00100000:1.0:1782756128.345684:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782756128.345691:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869355222574592:12345-0@lo:400: 00000100:00100000:1.0:1782756128.345730:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869355222574592:12345-0@lo:400: Request processed in 39us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756128.345736:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1782756128.348843:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3c78fc2a00 x1869355222574336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782756138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756128.348859:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782756128.348869:0:3313:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1782756128.348891:0:3313:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1782756128.348898:0:3313:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1782756128.348901:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9d3b4114f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1782756128.348913:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1782756128.348930:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869355222574336:0@lo:8: 00000100:00080000:2.0:1782756128.349109:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782756128.349127:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782756128.349141:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222574720:12345-0@lo:400: 00000100:00100000:2.0:1782756128.349225:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222574720:12345-0@lo:400: Request processed in 90us (3925us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756128.349232:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000004:00080000:2.0:1782756128.349255:0:6794:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1782756128.349394:0:6794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 169584318235ns, next at 0ns, rc = 0 00000020:01000000:2.0:1782756128.351514:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1782756128.351895:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1782756128.351908:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198a5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198a63 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756128.351945:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198a5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198a63 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782756128.351955:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782756128.351957:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9d3c4505a800 from 1 10000000:01000000:2.0:1782756128.351960:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782756128.351994:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41531a00/0x5e4fb0a8aa198a86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756128.352002:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c41531a00/0x5e4fb0a8aa198a86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756128.352013:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c41531a00/0x5e4fb0a8aa198a86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756128.352033:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b604700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222574848:0@lo:101: 00000100:00100000:2.0:1782756128.352114:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756128.352155:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c48cc9a80 going to sleep for 11 seconds 00010000:00080000:1.0:1782756128.352695:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3c78fc0000 x1869355222574592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782756144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756128.352710:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869355222574592:0@lo:400: 00010000:00080000:1.0:1782756128.352741:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3c78fc1500 x1869355222574720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782756144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756128.352750:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222574720:0@lo:400: 00000100:00100000:1.0:1782756128.352913:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222574848 00000100:00100000:1.0:1782756128.352932:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222574848 00000100:00100000:1.0:1782756128.352968:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1782756128.352976:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:5800:x1869355222574848:12345-0@lo:101: 00010000:00010000:1.0:1782756128.352988:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756128.353001:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c41496c00/0x5e4fb0a8aa198a8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198a86 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756128.353023:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c41496c00/0x5e4fb0a8aa198a8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198a86 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756128.353033:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c41496c00/0x5e4fb0a8aa198a8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198a86 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756128.353043:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41496c00, rc 0) 00000100:00100000:1.0:1782756128.353115:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:5800:x1869355222574848:12345-0@lo:101: Request processed in 138us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756128.353121:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1782756128.353160:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b604700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222574848:0@lo:101: 00010000:00010000:1.0:1782756128.353173:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c41531a00/0x5e4fb0a8aa198a86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198a8d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756128.353181:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c41531a00/0x5e4fb0a8aa198a86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198a8d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756128.353236:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222574976:0@lo:501: 00000100:00100000:1.0:1782756128.353260:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756128.353273:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78a50180 going to sleep for 11 seconds 00000100:00100000:1.0:1782756128.353284:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222574976 00000100:00100000:1.0:1782756128.353287:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222574976 00000100:00100000:1.0:1782756128.353303:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782756128.353309:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:5800:x1869355222574976:12345-0@lo:501: 00000100:00100000:1.0:1782756128.353483:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:5800:x1869355222574976:12345-0@lo:501: Request processed in 173us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756128.353489:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782756128.353531:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222574976:0@lo:501: 00000100:00100000:1.0:1782756128.353557:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222575104:0@lo:503: 00000100:00100000:1.0:1782756128.353592:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756128.353604:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78a50180 going to sleep for 11 seconds 00000100:00100000:1.0:1782756128.353614:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222575104 00000100:00100000:1.0:1782756128.353617:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222575104 00000100:00100000:1.0:1782756128.353635:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782756128.353647:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:5800:x1869355222575104:12345-0@lo:503: 00000100:00100000:1.0:1782756128.353913:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:5800:x1869355222575104:12345-0@lo:503: Request processed in 265us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756128.353933:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782756128.353975:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222575104:0@lo:503: 00000100:00100000:0.0:1782756128.358270:0:6796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:6796:1869355222575232:0@lo:502: 00000100:00100000:0.0:1782756128.358357:0:6796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756128.358382:0:6796:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c44e43600 going to sleep for 11 seconds 00000100:00100000:1.0:1782756128.360961:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222575232 00000100:00100000:1.0:1782756128.360975:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222575232 00000100:00100000:1.0:1782756128.361035:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1782756128.361045:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:6796:x1869355222575232:12345-0@lo:502: 00000100:00100000:1.0:1782756128.361379:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:6796:x1869355222575232:12345-0@lo:502: Request processed in 334us (3021us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756128.361387:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782756128.363266:0:6796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:6796:1869355222575232:0@lo:502: 00000020:01000000:2.0:1782756128.363310:0:6796:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782756128.363321:0:6796:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756128.363323:0:6796:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1782756128.363331:0:6796:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d3c4505a800 00000020:00000080:2.0:1782756128.363334:0:6796:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782756128.363372:0:6796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b605880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:6796:1869355222575360:0@lo:502: 00000100:00100000:2.0:1782756128.363437:0:6796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756128.363489:0:6796:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c48cc90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782756128.364065:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222575360 00000100:00100000:1.0:1782756128.364071:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222575360 00000100:00100000:1.0:1782756128.364476:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782756128.364485:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:6796:x1869355222575360:12345-0@lo:502: 00000100:00100000:1.0:1782756128.364775:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:6796:x1869355222575360:12345-0@lo:502: Request processed in 289us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756128.364785:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782756128.364810:0:6796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b605880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:6796:1869355222575360:0@lo:502: 00000020:01000000:0.0:1782756128.364872:0:6796:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782756128.364881:0:6796:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782756128.364883:0:6796:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1782756128.364887:0:6796:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1782756128.364959:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1782756128.364982:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782756128.364994:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41531a00/0x5e4fb0a8aa198a86 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198a8d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756128.365004:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c41531a00/0x5e4fb0a8aa198a86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198a8d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782756128.365014:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1782756128.365016:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9d3c4aba3380 from 1 10000000:01000000:0.0:1782756128.365019:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782756128.365054:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c40030a00/0x5e4fb0a8aa198a94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756128.365063:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c40030a00/0x5e4fb0a8aa198a94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756128.365072:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c40030a00/0x5e4fb0a8aa198a94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756128.365112:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222575488:0@lo:101: 00000100:00100000:0.0:1782756128.365155:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756128.365184:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c44e43f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782756128.365199:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222575488 00000100:00100000:0.0:1782756128.365202:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222575488 00000100:00100000:0.0:1782756128.365227:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782756128.365234:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:5800:x1869355222575488:12345-0@lo:101: 00010000:00010000:0.0:1782756128.365242:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756128.365255:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c40030000/0x5e4fb0a8aa198a9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198a94 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756128.365277:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c40030000/0x5e4fb0a8aa198a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198a94 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756128.365302:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c40030000/0x5e4fb0a8aa198a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198a94 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756128.365312:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c40030000, rc 0) 00000100:00100000:0.0:1782756128.365343:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:5800:x1869355222575488:12345-0@lo:101: Request processed in 110us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756128.365349:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782756128.365380:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222575488:0@lo:101: 00010000:00010000:0.0:1782756128.365394:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c40030a00/0x5e4fb0a8aa198a94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198a9b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756128.365402:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c40030a00/0x5e4fb0a8aa198a94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198a9b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756128.365443:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222575616:0@lo:501: 00000100:00100000:0.0:1782756128.365475:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756128.365763:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c44e43f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782756128.365777:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222575616 00000100:00100000:0.0:1782756128.365781:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222575616 00000100:00100000:0.0:1782756128.365803:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782756128.365810:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:5800:x1869355222575616:12345-0@lo:501: 00000100:00100000:0.0:1782756128.366143:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:5800:x1869355222575616:12345-0@lo:501: Request processed in 332us (665us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782756128.366150:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782756128.366187:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222575616:0@lo:501: 10000000:01000000:0.0:1782756128.366228:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1782756128.366235:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c40030a00/0x5e4fb0a8aa198a94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198a9b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756128.366242:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c40030a00/0x5e4fb0a8aa198a94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198a9b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782756128.398055:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1782756128.445704:0:6795:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1782756128.445737:0:6795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6795:1869355222575872:0@lo:7: 00000100:00100000:1.0:1782756128.445819:0:6795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756128.445870:0:6795:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78a50d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782756128.445886:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222575744:0@lo:13: 00000100:00100000:1.0:1782756128.445912:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756128.445978:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222575872 00000100:00100000:1.0:1782756128.445985:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222575872 00000100:00100000:1.0:1782756128.446030:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782756128.446037:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6795:x1869355222575872:12345-0@lo:7: 00000100:00100000:0.0:1782756128.446697:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222575744 00000100:00100000:0.0:1782756128.446763:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222575744 00000100:00100000:0.0:1782756128.446816:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782756128.446828:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1869355222575744:12345-0@lo:13: 00002000:00000024:0.0:1782756128.446857:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1782756128.446933:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1869355222575744:12345-0@lo:13: Request processed in 109us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756128.446942:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1782756128.447214:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3c78fc1500 x1869355222575744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756144 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756128.447235:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222575744:0@lo:13: 00000100:00080000:3.0:1782756128.448164:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1782756128.452839:0:6605:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1782756128.452849:0:6605:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1782756128.452962:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6795:x1869355222575872:12345-0@lo:7: Request processed in 6919us (7137us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756128.452976:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1782756128.453411:0:6795:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3c78fc0000 x1869355222575872/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782756144 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782756128.453436:0:6795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6795:1869355222575872:0@lo:7: 00000004:00080000:2.0:1782756128.453450:0:6795:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1782756128.453491:0:6795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b607b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6795:1869355222576000:0@lo:5: 00000100:00100000:2.0:1782756128.453535:0:6795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756128.453568:0:6795:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c48cc9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782756128.456062:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222576000 00000100:00100000:1.0:1782756128.456104:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222576000 00000100:00100000:1.0:1782756128.456168:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782756128.456179:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4b604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6795:x1869355222576000:12345-0@lo:5: 00002000:00080000:1.0:1782756128.456215:0:6603:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1782756128.456219:0:6603:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1782756128.456635:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4b604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6795:x1869355222576000:12345-0@lo:5: Request processed in 456us (3097us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1782756128.456643:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1782756128.457328:0:6795:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3c4b607b80 x1869355222576000/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782756144 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756128.457347:0:6795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b607b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6795:1869355222576000:0@lo:5: 00000004:00080000:3.0:1782756128.457361:0:6795:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1782756128.457403:0:6795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78a33100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6795:1869355222576128:0@lo:700: 00000100:00100000:3.0:1782756128.457444:0:6795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756128.457476:0:6795:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c6dcdce40 going to sleep for 11 seconds 00000100:00100000:1.0:1782756128.457544:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222576128 00000100:00100000:1.0:1782756128.457550:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222576128 00000100:00100000:1.0:1782756128.457587:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782756128.457595:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78a31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6795:x1869355222576128:12345-0@lo:700: 00000100:00100000:1.0:1782756128.457628:0:6611:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6611:1869355222576256:0@lo:700: 00000100:00100000:1.0:1782756128.457657:0:6611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756128.457686:0:6611:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78a50600 going to sleep for 11 seconds 00000100:00100000:3.0:1782756128.457720:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222576256 00000100:00100000:3.0:1782756128.457726:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222576256 00000100:00100000:3.0:1782756128.457818:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782756128.457826:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6611:x1869355222576256:12345-0@lo:700: 40000000:02000000:1.0:1782756128.512600:0:5810:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1782756128.517156:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6611:x1869355222576256:12345-0@lo:700: Request processed in 59323us (59489us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756128.517191:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1782756128.517415:0:6611:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3c78fc1f80 x1869355222576256/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782756144 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756128.517443:0:6611:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6611:1869355222576256:0@lo:700: 40000000:02000000:0.0:1782756128.517457:0:6611:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:2.0:1782756128.579056:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78a31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6795:x1869355222576128:12345-0@lo:700: Request processed in 121453us (121602us total) trans 0 rc 0/0 00000001:00080000:1.0:1782756128.579092:0:6627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:2.0:1782756128.579097:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00100000:1.0:1782756128.579109:0:6627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1782756128.579215:0:6795:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3c78a33100 x1869355222576128/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782756144 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756128.579230:0:6795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78a33100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6795:1869355222576128:0@lo:700: 00000004:02000040:0.0:1782756128.603856:0:6795:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1782756128.612152:0:6795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b607480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6795:1869355222576384:0@lo:5: 00000100:00100000:2.0:1782756128.612225:0:6795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756128.612294:0:6795:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c48cc9600 going to sleep for 11 seconds 00000100:00100000:3.0:1782756128.612429:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222576384 00000100:00100000:3.0:1782756128.612438:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222576384 00000100:00100000:3.0:1782756128.612499:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782756128.612511:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4b607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6795:x1869355222576384:12345-0@lo:5: 00002000:00080000:2.0:1782756128.618731:0:6605:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1782756128.618751:0:6605:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1782756128.622169:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4b607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6795:x1869355222576384:12345-0@lo:5: Request processed in 9654us (9936us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1782756128.622184:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1782756128.622413:0:6795:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3c4b607480 x1869355222576384/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782756144 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756128.622439:0:6795:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1782756128.622467:0:6795:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9d3c4b607480 x1869355222576384/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782756144 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756128.622479:0:6795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b607480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6795:1869355222576384:0@lo:5: 00000004:00080000:3.0:1782756128.622493:0:6795:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1782756129.228390:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782756130.250972:0:6971:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1782756130.257000:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756131.276534:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756132.300621:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756133.324237:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782756133.836339:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222576512:0@lo:13: 00000100:00100000:3.0:1782756133.836435:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756133.836445:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869355222576768:0@lo:400: 00000100:00100000:3.0:1782756133.836506:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222577024:0@lo:400: 00000100:00100000:2.0:1782756133.836512:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756133.836543:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782756133.836552:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222576896:0@lo:400: 00000100:00100000:2.0:1782756133.836585:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756133.836623:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222576768 00000100:00100000:2.0:1782756133.836632:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222576768 00000100:00100000:2.0:1782756133.836695:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222576896 00000100:00100000:2.0:1782756133.836699:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222576896 00000100:00100000:2.0:1782756133.836736:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782756133.836747:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4b605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869355222576768:12345-0@lo:400: 00000100:00100000:2.0:1782756133.836890:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4b605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869355222576768:12345-0@lo:400: Request processed in 145us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756133.836899:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756133.836905:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782756133.836927:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782756133.836930:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782756133.836939:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222576640:0@lo:400: 00000100:00100000:2.0:1782756133.836946:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4b604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222576896:12345-0@lo:400: 00000100:00100000:3.0:1782756133.836974:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756133.836987:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4b604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222576896:12345-0@lo:400: Request processed in 43us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756133.836994:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782756133.837039:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222576512 00000100:00100000:3.0:1782756133.837043:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222576512 00000100:00080000:2.0:1782756133.837044:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782756133.837094:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222577024 00000100:00100000:2.0:1782756133.837098:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222577024 00000100:00100000:2.0:1782756133.837136:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782756133.837141:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782756133.837148:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78a32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3316:x1869355222577024:12345-0@lo:400: 00000100:00100000:3.0:1782756133.837155:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78a30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1869355222576512:12345-0@lo:13: 00002000:00000024:3.0:1782756133.837187:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:1.0:1782756133.837349:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3c4b605c00 x1869355222576896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782756149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756133.837363:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222576896:0@lo:400: 00010000:00080000:1.0:1782756133.837374:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3c4b605f80 x1869355222576768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782756149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756133.837381:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869355222576768:0@lo:400: 00000100:00100000:2.0:1782756133.837721:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78a32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3316:x1869355222577024:12345-0@lo:400: Request processed in 575us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756133.837729:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782756133.837875:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222576640 00000100:00100000:3.0:1782756133.837898:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78a30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1869355222576512:12345-0@lo:13: Request processed in 748us (1463us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756133.837903:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222576640 00000100:00100000:3.0:1782756133.837909:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1782756133.837951:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782756133.837952:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782756133.837964:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:3316:x1869355222576640:12345-0@lo:400: 00010000:00080000:3.0:1782756133.837979:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3c4b607b80 x1869355222577024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756133.838006:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:3316:x1869355222576640:12345-0@lo:400: Request processed in 44us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756133.838007:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222577024:0@lo:400: 00000100:00100000:0.0:1782756133.838020:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1782756133.838032:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3c78a32d80 x1869355222576512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756149 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756133.838046:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222576512:0@lo:13: 00000100:00100000:3.0:1782756133.838098:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222576640:0@lo:400: 00000001:00080000:1.0:1782756133.917622:0:6627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1782756134.351281:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756135.372535:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756136.396660:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756137.420364:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1782756138.102725:0:7487:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1782756138.102738:0:7487:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1782756138.102893:0:7487:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9d3c80977000 00000020:01000004:0.0:1782756138.102910:0:7487:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1782756138.102925:0:7487:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1782756138.102939:0:7487:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9d3c76f04d40) 00000020:00000080:0.0:1782756138.102955:0:7487:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1782756138.122401:0:7487:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1782756138.123062:0:7487:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1782756138.145659:0:7487:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1782756138.153042:0:7487:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1782756138.153112:0:7487:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1782756138.153174:0:7487:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1782756138.153203:0:7487:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1782756138.153721:0:7487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1782756138.153746:0:7487:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782756138.153758:0:7487:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5e4fb0a8aa198aa9 00000020:01000004:3.0:1782756138.153766:0:7487:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1782756138.153794:0:7487:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.125@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1782756138.153799:0:7487:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1782756138.153806:0:7487:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1782756138.153829:0:7487:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1782756138.153834:0:7487:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.125@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1782756138.183180:0:7487:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.125@tcp ctxt 0 is initialized 00000020:01000004:2.0:1782756138.183213:0:7487:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.125@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1782756138.183217:0:7487:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1782756138.183219:0:7487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782756138.183220:0:7487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782756138.183221:0:7487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782756138.183222:0:7487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782756138.183223:0:7487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782756138.183224:0:7487:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782756138.183226:0:7487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782756138.183227:0:7487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782756138.183228:0:7487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782756138.183229:0:7487:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782756138.183235:0:7487:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1782756138.183237:0:7487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782756138.183238:0:7487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782756138.183239:0:7487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782756138.183240:0:7487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782756138.183241:0:7487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782756138.183241:0:7487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782756138.183242:0:7487:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782756138.183243:0:7487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782756138.183244:0:7487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782756138.183245:0:7487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782756138.183245:0:7487:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782756138.183271:0:7487:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1782756138.183290:0:7487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b604000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222577152:0@lo:253: 00000100:00100000:2.0:1782756138.183369:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756138.183429:0:7487:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c6dcdc780 going to sleep for 11 seconds 00000100:00100000:0.0:1782756138.185117:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222577152 00000100:00100000:0.0:1782756138.185143:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222577152 00000100:00100000:0.0:1782756138.185239:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782756138.185250:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:7487:x1869355222577152:12345-0@lo:253: 20000000:01000000:0.0:1782756138.185285:0:5796:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1782756138.185290:0:5796:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1782756138.185294:0:5796:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1782756138.185298:0:5796:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1782756138.189373:0:5796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782756138.189619:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1782756138.189635:0:5796:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1782756138.189677:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1782756138.189685:0:5796:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1782756138.189717:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1782756138.189780:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1782756138.190556:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1782756138.190580:0:5796:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.125@tcp 20000000:01000000:0.0:1782756138.190582:0:5796:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.125@tcp (null) (null) (null) 00000040:00080000:0.0:1782756138.190619:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1782756138.190627:0:5796:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1782756138.190674:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1782756138.190682:0:5796:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.125@tcp (null) (null) 00000040:00080000:0.0:1782756138.190715:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1782756138.192447:0:5796:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1782756138.192551:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1782756138.192633:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1782756138.195417:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1782756138.195449:0:5796:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.125@tcp 20000000:01000000:0.0:1782756138.195452:0:5796:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.125@tcp (null) (null) (null) 00000040:00080000:0.0:1782756138.195491:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1782756138.195500:0:5796:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1782756138.195535:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1782756138.195553:0:5796:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.125@tcp (null) (null) 00000040:00080000:0.0:1782756138.195590:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1782756138.195600:0:5796:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1782756138.195649:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1782756138.195687:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1782756138.195703:0:5796:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1782756138.195706:0:5796:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1782756138.195712:0:5796:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1782756138.195713:0:5796:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1782756138.195715:0:5796:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1782756138.195738:0:5796:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1782756138.195741:0:5796:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1782756138.195777:0:5796:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1782756138.195779:0:5796:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1782756138.199271:0:7489:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1782756138.199361:0:7489:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1782756138.199420:0:7489:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1782756138.199912:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1782756138.199970:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1782756138.200034:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1782756138.200048:0:5796:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1782756138.200051:0:5796:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1782756138.200583:0:7490:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1782756138.200798:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1782756138.200857:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1782756138.200929:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1782756138.200954:0:5796:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1782756138.200956:0:5796:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1782756138.203350:0:7491:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1782756138.203456:0:7491:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1782756138.203514:0:7491:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1782756138.209914:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1782756138.209964:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1782756138.209992:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1782756138.210006:0:5796:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1782756138.210008:0:5796:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1782756138.212450:0:7492:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1782756138.212565:0:7492:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1782756138.212605:0:7492:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1782756138.212985:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1782756138.213032:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1782756138.213154:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:0.0:1782756138.213176:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1782756138.213197:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa198ab0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756138.213221:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa1989f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa1989ec expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756138.213241:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c40031c00/0x5e4fb0a8aa198a1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198a16 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756138.213249:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198a40 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756138.213256:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c41530e00/0x5e4fb0a8aa198a63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198a5c expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756138.213263:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c40030000/0x5e4fb0a8aa198a9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198a94 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756138.213272:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa198ab0 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756138.213313:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c40030000/0x5e4fb0a8aa198a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa198a94 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756138.213329:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d3c40030000/0x5e4fb0a8aa198a9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a94 expref: 16 pid: 5796 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756138.213344:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1869355222577280:0@lo:104: 00000100:00100000:0.0:1782756138.213418:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782756138.213461:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c41530e00/0x5e4fb0a8aa198a63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa198a5c expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756138.213470:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d3c41530e00/0x5e4fb0a8aa198a63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a5c expref: 16 pid: 5796 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756138.213479:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1869355222577408:0@lo:104: 00010000:00010000:0.0:1782756138.213511:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa198a40 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756138.213520:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198a47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a40 expref: 16 pid: 5796 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756138.213529:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1869355222577536:0@lo:104: 00010000:00010000:0.0:1782756138.213549:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c40031c00/0x5e4fb0a8aa198a1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa198a16 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756138.213558:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d3c40031c00/0x5e4fb0a8aa198a1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a16 expref: 16 pid: 5798 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756138.213566:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f5180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1869355222577664:0@lo:104: 00010000:00010000:0.0:1782756138.213587:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa1989f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa1989ec expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756138.213595:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa1989f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa1989ec expref: 16 pid: 5798 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756138.213603:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1869355222577792:0@lo:104: 00000100:00100000:0.0:1782756138.213634:0:5796:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76f31840 going to sleep for 11 seconds 00000100:00100000:1.0:1782756138.213770:0:5787:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782756138.213789:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756138.213821:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756138.213831:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756138.213840:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756138.213851:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222577280 00000100:00100000:1.0:1782756138.213858:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222577280 00000100:00100000:1.0:1782756138.213891:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222577408 00000100:00100000:1.0:1782756138.213894:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222577408 00000100:00100000:1.0:1782756138.213914:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222577536 00000100:00100000:1.0:1782756138.213916:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222577536 00000100:00100000:1.0:1782756138.213925:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222577664 00000100:00100000:1.0:1782756138.213928:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222577664 00000100:00100000:1.0:1782756138.213936:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222577792 00000100:00100000:1.0:1782756138.213939:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222577792 00000100:00100000:1.0:1782756138.213952:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782756138.213961:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c50035050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+7:5796:x1869355222577280:12345-0@lo:104: 00010000:00010000:1.0:1782756138.213974:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: ffff9d3c40030a00/0x5e4fb0a8aa198a94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198a9b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.214037:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782756138.214044:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c50035050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+7:5796:x1869355222577280:12345-0@lo:104: Request processed in 85us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756138.214053:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782756138.214112:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782756138.214119:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+6:5796:x1869355222577408:12345-0@lo:104: 00010000:00010000:1.0:1782756138.214127:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198a5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198a63 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.214159:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782756138.214165:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+6:5796:x1869355222577408:12345-0@lo:104: Request processed in 47us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756138.214170:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782756138.214181:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782756138.214187:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+5:5796:x1869355222577536:12345-0@lo:104: 00010000:00010000:1.0:1782756138.214195:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: ffff9d3c41530800/0x5e4fb0a8aa198a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198a47 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.214233:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1782756138.214239:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+5:5796:x1869355222577536:12345-0@lo:104: Request processed in 53us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756138.214245:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782756138.214256:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782756138.214262:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+4:5796:x1869355222577664:12345-0@lo:104: 00010000:00010000:1.0:1782756138.214270:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: ffff9d3c41497000/0x5e4fb0a8aa198a16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198a1d expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.214294:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1782756138.214298:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+4:5796:x1869355222577664:12345-0@lo:104: Request processed in 38us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756138.214304:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782756138.214313:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782756138.214319:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+3:5796:x1869355222577792:12345-0@lo:104: 00010000:00010000:1.0:1782756138.214326:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d600/0x5e4fb0a8aa1989ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa1989f3 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.214349:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1782756138.214354:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+3:5796:x1869355222577792:12345-0@lo:104: Request processed in 36us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756138.214359:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1782756138.214376:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1782756138.214381:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c40030a00/0x5e4fb0a8aa198a94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198a9b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.214388:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c40030a00 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:1.0:1782756138.214398:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c40030a00/0x5e4fb0a8aa198a94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa198a9b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.214406:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c40030a00/0x5e4fb0a8aa198a94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa198a9b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782756138.214413:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c40030a00/0x5e4fb0a8aa198a94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa198a9b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756138.214420:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782756138.214449:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c40030a00/0x5e4fb0a8aa198a94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198a9b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.214456:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782756138.214473:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c40030a00/0x5e4fb0a8aa198a94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198a9b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.214479:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c40030a00/0x5e4fb0a8aa198a94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198a9b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.214492:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1782756138.214496:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198a5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198a63 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.214501:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41530c00 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:1.0:1782756138.214504:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198a5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa198a63 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.214511:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198a5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa198a63 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782756138.214527:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198a5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa198a63 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756138.214532:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782756138.214544:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198a5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198a63 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.214549:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782756138.214564:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198a5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198a63 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.214571:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198a5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198a63 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.214581:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782756138.214583:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c41530800/0x5e4fb0a8aa198a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198a47 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.214589:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41530800 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:1.0:1782756138.214591:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41530800/0x5e4fb0a8aa198a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa198a47 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.214598:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c41530800/0x5e4fb0a8aa198a40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa198a47 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782756138.214604:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41530800/0x5e4fb0a8aa198a40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa198a47 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756138.214608:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782756138.214628:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c41530800/0x5e4fb0a8aa198a40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198a47 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.214633:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782756138.214639:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c41530800/0x5e4fb0a8aa198a40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198a47 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.214644:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c41530800/0x5e4fb0a8aa198a40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198a47 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.214652:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782756138.214655:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c41497000/0x5e4fb0a8aa198a16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198a1d expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.214662:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41497000 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:1.0:1782756138.214664:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41497000/0x5e4fb0a8aa198a16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa198a1d expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.214669:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c41497000/0x5e4fb0a8aa198a16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa198a1d expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782756138.214675:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41497000/0x5e4fb0a8aa198a16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa198a1d expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756138.214679:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782756138.214690:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c41497000/0x5e4fb0a8aa198a16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198a1d expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.214695:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782756138.214699:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c41497000/0x5e4fb0a8aa198a16 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198a1d expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.214714:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c41497000/0x5e4fb0a8aa198a16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198a1d expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.214723:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782756138.214744:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d600/0x5e4fb0a8aa1989ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa1989f3 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.214750:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168d600 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:1.0:1782756138.214752:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d600/0x5e4fb0a8aa1989ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa1989f3 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.214758:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d600/0x5e4fb0a8aa1989ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa1989f3 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782756138.214764:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d600/0x5e4fb0a8aa1989ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa1989f3 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756138.214769:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782756138.214783:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d600/0x5e4fb0a8aa1989ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa1989f3 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.214788:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782756138.214792:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d600/0x5e4fb0a8aa1989ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa1989f3 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.214799:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d600/0x5e4fb0a8aa1989ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa1989f3 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.214812:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756138.214820:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756138.214822:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756138.214830:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756138.214849:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222577920:0@lo:103: 00000100:00100000:1.0:1782756138.214883:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756138.214904:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222578432:0@lo:103: 00000100:00100000:1.0:1782756138.214937:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756138.214956:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782756138.214961:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222578304:0@lo:103: 00000100:00100000:1.0:1782756138.214990:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756138.215018:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0daec403-69b6-4c98-a0ea-f519ca0a480f:3314:1869355222578048:0@lo:103: 00000100:00100000:1.0:1782756138.215039:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756138.215051:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782756138.215055:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0daec403-69b6-4c98-a0ea-f519ca0a480f:3314:1869355222578176:0@lo:103: 00000100:00100000:1.0:1782756138.215094:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756138.215121:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222577920 00000100:00100000:1.0:1782756138.215126:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222577920 00010000:00010000:1.0:1782756138.215145:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c40030000/0x5e4fb0a8aa198a9b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a94 expref: 17 pid: 5796 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756138.215160:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222578432 00000100:00100000:1.0:1782756138.215163:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222578432 00010000:00010000:1.0:1782756138.215173:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa1989f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa1989ec expref: 18 pid: 5798 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756138.215183:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222578304 00000100:00100000:1.0:1782756138.215186:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222578304 00010000:00010000:1.0:1782756138.215195:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c40031c00/0x5e4fb0a8aa198a1d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a16 expref: 19 pid: 5798 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756138.215218:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222578048 00000100:00100000:1.0:1782756138.215222:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222578048 00010000:00010000:1.0:1782756138.215233:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c41530e00/0x5e4fb0a8aa198a63 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a5c expref: 20 pid: 5796 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756138.215243:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222578176 00000100:00100000:1.0:1782756138.215246:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222578176 00010000:00010000:1.0:1782756138.215256:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198a47 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a40 expref: 21 pid: 5796 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756138.215268:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782756138.215275:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+21:3317:x1869355222577920:12345-0@lo:103: 00010000:00010000:1.0:1782756138.215286:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756138.215291:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c40030000/0x5e4fb0a8aa198a9b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a94 expref: 21 pid: 5796 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.215301:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c40030000/0x5e4fb0a8aa198a9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a94 expref: 21 pid: 5796 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.215315:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782756138.215346:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+21:3317:x1869355222577920:12345-0@lo:103: Request processed in 71us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756138.215352:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782756138.215366:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782756138.215371:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+20:3317:x1869355222578432:12345-0@lo:103: 00010000:00010000:1.0:1782756138.215379:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756138.215383:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa1989f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa1989ec expref: 20 pid: 5798 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.215401:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa1989f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa1989ec expref: 20 pid: 5798 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.215410:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782756138.215432:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+20:3317:x1869355222578432:12345-0@lo:103: Request processed in 61us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756138.215438:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782756138.215449:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782756138.215454:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3317:x1869355222578304:12345-0@lo:103: 00010000:00010000:1.0:1782756138.215462:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756138.215466:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c40031c00/0x5e4fb0a8aa198a1d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a16 expref: 19 pid: 5798 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.215475:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c40031c00/0x5e4fb0a8aa198a1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a16 expref: 19 pid: 5798 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.215483:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782756138.215503:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3317:x1869355222578304:12345-0@lo:103: Request processed in 49us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756138.215509:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782756138.215519:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782756138.215525:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fcc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:3314:x1869355222578048:12345-0@lo:103: 00010000:00010000:1.0:1782756138.215541:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756138.215547:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c41530e00/0x5e4fb0a8aa198a63 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a5c expref: 18 pid: 5796 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.215557:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c41530e00/0x5e4fb0a8aa198a63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a5c expref: 18 pid: 5796 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.215577:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782756138.215617:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fcc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:3314:x1869355222578048:12345-0@lo:103: Request processed in 90us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756138.215624:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782756138.215646:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782756138.215654:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fcd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:3314:x1869355222578176:12345-0@lo:103: 00010000:00010000:1.0:1782756138.215663:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756138.215668:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198a47 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a40 expref: 17 pid: 5796 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.215676:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198a47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a40 expref: 17 pid: 5796 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.215687:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa198ab0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.215695:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa198ab0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.215709:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa198ab0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.215716:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa198ab0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.215722:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa198ab0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.215739:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa198ab0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.215750:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c40030c00 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:1.0:1782756138.215754:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa198ab0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.215762:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa198ab0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.215770:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa198ab0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.215780:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782756138.215803:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fcd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:3314:x1869355222578176:12345-0@lo:103: Request processed in 150us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756138.215809:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782756138.215847:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0daec403-69b6-4c98-a0ea-f519ca0a480f:3314:1869355222578176:0@lo:103: 00000100:00100000:1.0:1782756138.215855:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0daec403-69b6-4c98-a0ea-f519ca0a480f:3314:1869355222578048:0@lo:103: 00000100:00100000:1.0:1782756138.215879:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222578304:0@lo:103: 00000100:00100000:1.0:1782756138.215886:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222577920:0@lo:103: 00000100:00100000:1.0:1782756138.215892:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222578432:0@lo:103: 00010000:00010000:0.0:1782756138.216190:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c40030000/0x5e4fb0a8aa198a9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a94 expref: 16 pid: 5796 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756138.216203:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1869355222577280:0@lo:104: 00010000:00010000:0.0:1782756138.216214:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c41530e00/0x5e4fb0a8aa198a63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a5c expref: 15 pid: 5796 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756138.216238:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1869355222577408:0@lo:104: 00010000:00010000:0.0:1782756138.216253:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198a47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a40 expref: 14 pid: 5796 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756138.216261:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1869355222577536:0@lo:104: 00010000:00010000:0.0:1782756138.216269:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c40031c00/0x5e4fb0a8aa198a1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a16 expref: 13 pid: 5798 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756138.216278:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f5180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1869355222577664:0@lo:104: 00010000:00010000:0.0:1782756138.216286:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa1989f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa1989ec expref: 12 pid: 5798 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756138.216294:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1869355222577792:0@lo:104: 00010000:00010000:0.0:1782756138.216316:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa198ab0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756138.216326:0:5796:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa198ab0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756138.216333:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa198ab0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756138.216339:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa198ab0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782756138.216351:0:5796:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1782756138.265501:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:7487:x1869355222577152:12345-0@lo:253: Request processed in 80245us (82123us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756138.265536:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782756138.265739:0:7487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b604000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222577152:0@lo:253: 10000000:01000000:2.0:1782756138.265756:0:7487:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1782756138.265760:0:7487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782756138.265761:0:7487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782756138.265763:0:7487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782756138.265764:0:7487:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1782756138.265765:0:7487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782756138.265767:0:7487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782756138.265768:0:7487:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782756138.265770:0:7487:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1782756138.265772:0:7487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782756138.265773:0:7487:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1782756138.265795:0:7487:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d3c80977000 from lustre-OST0001 10000000:01000000:2.0:1782756138.265820:0:7487:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1782756138.265823:0:7487:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1782756138.265830:0:7487:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d3c4aba3380 local copy 10000000:01000000:2.0:1782756138.265840:0:7487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1782756138.265879:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41530e00/0x5e4fb0a8aa198ab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756138.265891:0:7487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.125@tcp lock: ffff9d3c41530e00/0x5e4fb0a8aa198ab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756138.265900:0:7487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c41530e00/0x5e4fb0a8aa198ab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756138.265919:0:7487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b604000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222578560:0@lo:101: 00000100:00100000:2.0:1782756138.265956:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756138.266137:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222578560 00000100:00100000:2.0:1782756138.266139:0:7487:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c6dcdce40 going to sleep for 11 seconds 00000100:00100000:0.0:1782756138.266144:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222578560 00000100:00100000:2.0:1782756138.266509:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782756138.266523:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+11:7487:x1869355222578560:12345-0@lo:101: 00010000:00010000:2.0:1782756138.266536:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756138.266550:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c41530800/0x5e4fb0a8aa198abe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198ab7 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756138.266574:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c41530800/0x5e4fb0a8aa198abe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198ab7 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756138.266661:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c41530800/0x5e4fb0a8aa198abe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198ab7 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756138.266672:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41530800, rc 0) 00000100:00100000:2.0:1782756138.266717:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:7487:x1869355222578560:12345-0@lo:101: Request processed in 199us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756138.266735:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782756138.266766:0:7487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b604000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222578560:0@lo:101: 00010000:00010000:3.0:1782756138.266788:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c41530e00/0x5e4fb0a8aa198ab7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5e4fb0a8aa198abe expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756138.266796:0:7487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c41530e00/0x5e4fb0a8aa198ab7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5e4fb0a8aa198abe expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756138.266888:0:7487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78a32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222578688:0@lo:501: 00000100:00100000:3.0:1782756138.266916:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756138.266946:0:7487:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a04b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782756138.267001:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222578688 00000100:00100000:0.0:1782756138.267006:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222578688 00000100:00100000:0.0:1782756138.267034:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782756138.267041:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:7487:x1869355222578688:12345-0@lo:501: 00000100:00100000:0.0:1782756138.267374:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:7487:x1869355222578688:12345-0@lo:501: Request processed in 332us (455us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782756138.267382:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782756138.267440:0:7487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78a32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222578688:0@lo:501: 10000000:01000000:3.0:1782756138.267454:0:7487:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1782756138.267482:0:7487:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1782756138.267488:0:7487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41530e00/0x5e4fb0a8aa198ab7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5e4fb0a8aa198abe expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756138.267497:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41530e00/0x5e4fb0a8aa198ab7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5e4fb0a8aa198abe expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756138.267503:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.125@tcp lock: ffff9d3c41530e00/0x5e4fb0a8aa198ab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5e4fb0a8aa198abe expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756138.267529:0:7487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782756138.267547:0:7487:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d3c80977000 10000000:01000000:3.0:1782756138.267552:0:7487:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782756138.267558:0:7487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1782756138.267560:0:7487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782756138.267564:0:7487:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1782756138.267566:0:7487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1782756138.267682:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782756138.267690:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c41530e00/0x5e4fb0a8aa198ab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5e4fb0a8aa198abe expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.267698:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41530e00 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:1.0:1782756138.267701:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41530e00/0x5e4fb0a8aa198ab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5e4fb0a8aa198abe expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.267718:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c41530e00/0x5e4fb0a8aa198ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x5e4fb0a8aa198abe expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782756138.267734:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41530e00/0x5e4fb0a8aa198ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x5e4fb0a8aa198abe expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756138.267740:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782756138.267759:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c41530e00/0x5e4fb0a8aa198ab7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5e4fb0a8aa198abe expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.267766:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1782756138.267825:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1782756138.267845:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c41530e00/0x5e4fb0a8aa198ab7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5e4fb0a8aa198abe expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.267852:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c41530e00/0x5e4fb0a8aa198ab7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5e4fb0a8aa198abe expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.267870:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756138.267872:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756138.267874:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756138.267909:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4168cc00/0x5e4fb0a8aa198ac5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756138.267917:0:7487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c4168cc00/0x5e4fb0a8aa198ac5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756138.267927:0:7487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c4168cc00/0x5e4fb0a8aa198ac5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756138.267942:0:7487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78a32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222578816:0@lo:101: 00000100:00100000:3.0:1782756138.267975:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756138.268009:0:7487:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a04b900 going to sleep for 11 seconds 00000100:00100000:1.0:1782756138.268168:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222578816 00000100:00100000:1.0:1782756138.268173:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222578816 00000100:00100000:1.0:1782756138.268201:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782756138.268209:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:7487:x1869355222578816:12345-0@lo:101: 00010000:00010000:1.0:1782756138.268218:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756138.268230:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c41497000/0x5e4fb0a8aa198acc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198ac5 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.268246:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c41497000/0x5e4fb0a8aa198acc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198ac5 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.268264:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c41497000/0x5e4fb0a8aa198acc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198ac5 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.268272:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41497000, rc 0) 00000100:00100000:1.0:1782756138.268305:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:7487:x1869355222578816:12345-0@lo:101: Request processed in 96us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756138.268310:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782756138.268457:0:7487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78a32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222578816:0@lo:101: 00010000:00010000:3.0:1782756138.268468:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c4168cc00/0x5e4fb0a8aa198ac5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198acc expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756138.268476:0:7487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c4168cc00/0x5e4fb0a8aa198ac5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198acc expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756138.268544:0:7487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78a32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222579072:0@lo:501: 00000100:00100000:3.0:1782756138.268571:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756138.268608:0:7487:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a04b900 going to sleep for 11 seconds 00000100:00100000:1.0:1782756138.268705:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222579072 00000100:00100000:1.0:1782756138.268709:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222579072 00000100:00100000:0.0:1782756138.268759:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0daec403-69b6-4c98-a0ea-f519ca0a480f:3315:1869355222578944:0@lo:103: 00000100:00100000:1.0:1782756138.268787:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782756138.268788:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756138.268794:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:7487:x1869355222579072:12345-0@lo:501: 00000100:00100000:3.0:1782756138.268939:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222578944 00000100:00100000:3.0:1782756138.268944:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222578944 00000100:00100000:3.0:1782756138.268980:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782756138.268987:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c809f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:3315:x1869355222578944:12345-0@lo:103: 00010000:00010000:3.0:1782756138.268996:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782756138.269007:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:7487:x1869355222579072:12345-0@lo:501: Request processed in 214us (436us total) trans 0 rc 0/0 00010000:00010000:3.0:1782756138.269010:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c41530800/0x5e4fb0a8aa198abe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5e4fb0a8aa198ab7 expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756138.269014:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:3.0:1782756138.269033:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782756138.269069:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c809f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:3315:x1869355222578944:12345-0@lo:103: Request processed in 82us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756138.269093:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782756138.269099:0:7487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78a32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222579072:0@lo:501: 00000100:00100000:0.0:1782756138.269127:0:7487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222579200:0@lo:503: 00000100:00100000:0.0:1782756138.269164:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756138.269186:0:7487:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76f313c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782756138.269204:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222579200 00000100:00100000:1.0:1782756138.269257:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0daec403-69b6-4c98-a0ea-f519ca0a480f:3315:1869355222578944:0@lo:103: 00000100:00100000:2.0:1782756138.269306:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222579200 00000100:00100000:2.0:1782756138.269337:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782756138.269344:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:7487:x1869355222579200:12345-0@lo:503: 00000100:00100000:2.0:1782756138.269473:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:7487:x1869355222579200:12345-0@lo:503: Request processed in 129us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756138.269480:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782756138.269503:0:7487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222579200:0@lo:503: 00000040:00080000:0.0:1782756138.269883:0:7487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782756138.269936:0:7487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222579328:0@lo:502: 00000100:00100000:0.0:1782756138.269967:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756138.269989:0:7487:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76f313c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782756138.270041:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222579328 00000100:00100000:1.0:1782756138.270046:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222579328 00000100:00100000:1.0:1782756138.270153:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782756138.270162:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:7487:x1869355222579328:12345-0@lo:502: 00000100:00100000:1.0:1782756138.270296:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:7487:x1869355222579328:12345-0@lo:502: Request processed in 135us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756138.270303:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782756138.270371:0:7487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222579328:0@lo:502: 00000040:00080000:0.0:1782756138.270751:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1782756138.270803:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1782756138.270852:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1782756138.270902:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1782756138.270941:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1782756138.270976:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1782756138.271003:0:7487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222579456:0@lo:502: 00000100:00100000:0.0:1782756138.271044:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756138.271155:0:7487:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76f313c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782756138.271231:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222579456 00000100:00100000:2.0:1782756138.271237:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222579456 00000100:00100000:1.0:1782756138.271358:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782756138.271368:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:7487:x1869355222579456:12345-0@lo:502: 00000100:00100000:1.0:1782756138.271563:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:7487:x1869355222579456:12345-0@lo:502: Request processed in 195us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756138.271577:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1782756138.271709:0:7487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222579456:0@lo:502: 00000040:00080000:0.0:1782756138.271809:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1782756138.271819:0:7487:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1782756138.272447:0:7494:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782756138.272456:0:7494:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1782756138.272464:0:7494:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782756138.272466:0:7494:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1782756138.272472:0:7494:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782756138.272488:0:7494:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9d3c500219c0) 00000020:00000080:3.0:1782756138.272508:0:7494:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1782756138.272513:0:7494:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1782756138.272578:0:7494:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3c80977000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1782756138.272698:0:7494:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1782756138.272707:0:7494:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5e4fb0a8aa198ada 00010000:00010000:3.0:1782756138.276777:0:7494:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1782756138.277225:0:7494:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1782756138.282835:0:7494:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1782756138.283238:0:7494:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1782756138.287769:0:7494:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1782756138.288372:0:7494:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1782756138.291417:0:7494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1782756138.291430:0:7494:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782756138.291437:0:7494:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782756138.291439:0:7494:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1782756138.291445:0:7494:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782756138.291449:0:7494:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782756138.291451:0:7494:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782756138.291453:0:7494:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782756138.291455:0:7494:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1782756138.291551:0:7494:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782756138.291555:0:7494:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782756138.291557:0:7494:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1782756138.291561:0:7494:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1782756138.291744:0:7487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1782756138.291769:0:7487:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1782756138.291799:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4168cc00/0x5e4fb0a8aa198ac5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198acc expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756138.291812:0:7487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c4168cc00/0x5e4fb0a8aa198ac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198acc expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782756138.291822:0:7487:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9d3c80977000 from 1 10000000:01000000:0.0:1782756138.291824:0:7487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782756138.291873:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c40030c00/0x5e4fb0a8aa198ae1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756138.291881:0:7487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c40030c00/0x5e4fb0a8aa198ae1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756138.291892:0:7487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c40030c00/0x5e4fb0a8aa198ae1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756138.291916:0:7487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222579584:0@lo:101: 00000100:00100000:0.0:1782756138.291991:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756138.292032:0:7487:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76f31840 going to sleep for 11 seconds 00000100:00100000:1.0:1782756138.294417:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222579584 00000100:00100000:1.0:1782756138.294432:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222579584 00000100:00100000:1.0:1782756138.294495:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782756138.294505:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:7487:x1869355222579584:12345-0@lo:101: 00010000:00010000:1.0:1782756138.294523:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756138.294539:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c41497200/0x5e4fb0a8aa198ae8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198ae1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.294568:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c41497200/0x5e4fb0a8aa198ae8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198ae1 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.294580:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c41497200/0x5e4fb0a8aa198ae8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198ae1 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.294589:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41497200, rc 0) 00000100:00100000:1.0:1782756138.294662:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:7487:x1869355222579584:12345-0@lo:101: Request processed in 159us (2671us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756138.294670:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782756138.294719:0:7487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222579584:0@lo:101: 00010000:00010000:1.0:1782756138.294751:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c40030c00/0x5e4fb0a8aa198ae1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198ae8 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.294761:0:7487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c40030c00/0x5e4fb0a8aa198ae1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198ae8 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756138.294877:0:7487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fcfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222579712:0@lo:501: 00000100:00100000:1.0:1782756138.294912:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756138.294952:0:7487:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c6a2f6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782756138.294970:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222579712 00000100:00100000:1.0:1782756138.294975:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222579712 00000100:00100000:1.0:1782756138.294993:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782756138.295000:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:7487:x1869355222579712:12345-0@lo:501: 00000100:00100000:1.0:1782756138.295252:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:7487:x1869355222579712:12345-0@lo:501: Request processed in 250us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756138.295258:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782756138.295292:0:7487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fcfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222579712:0@lo:501: 00000100:00100000:1.0:1782756138.295318:0:7487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fcfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222579840:0@lo:503: 00000100:00100000:1.0:1782756138.295355:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756138.295367:0:7487:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c6a2f6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782756138.295380:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222579840 00000100:00100000:1.0:1782756138.295384:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222579840 00000100:00100000:1.0:1782756138.295401:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1782756138.295406:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:7487:x1869355222579840:12345-0@lo:503: 00000100:00100000:1.0:1782756138.295675:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:7487:x1869355222579840:12345-0@lo:503: Request processed in 268us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756138.295681:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1782756138.295718:0:7487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fcfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222579840:0@lo:503: 00000040:00080000:1.0:1782756138.298499:0:7487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782756138.298597:0:7487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fcfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222579968:0@lo:502: 00000100:00100000:1.0:1782756138.298670:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756138.298764:0:7487:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c468269c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782756138.298797:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222579968 00000100:00100000:1.0:1782756138.298804:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222579968 00000100:00100000:2.0:1782756138.298969:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782756138.298983:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:7487:x1869355222579968:12345-0@lo:502: 00000100:00100000:2.0:1782756138.299273:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:7487:x1869355222579968:12345-0@lo:502: Request processed in 294us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756138.299281:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1782756138.299511:0:7487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fcfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222579968:0@lo:502: 00000040:00080000:1.0:1782756138.299935:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1782756138.300002:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1782756138.300034:0:7487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fcfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222580096:0@lo:502: 00000100:00100000:1.0:1782756138.300113:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756138.300153:0:7487:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c468269c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782756138.300173:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222580096 00000100:00100000:1.0:1782756138.300179:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222580096 00000100:00100000:1.0:1782756138.300221:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1782756138.300230:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:7487:x1869355222580096:12345-0@lo:502: 00000100:00100000:1.0:1782756138.300376:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:7487:x1869355222580096:12345-0@lo:502: Request processed in 148us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756138.300383:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1782756138.300416:0:7487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fcfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222580096:0@lo:502: 00000040:00080000:0.0:1782756138.301045:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1782756138.301056:0:7487:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1782756138.302036:0:7498:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782756138.302050:0:7498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782756138.302052:0:7498:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1782756138.302148:0:7498:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d3c80977000 00000020:00000080:1.0:1782756138.302151:0:7498:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782756138.302261:0:7498:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782756138.302265:0:7498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782756138.302266:0:7498:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1782756138.302270:0:7498:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1782756138.302505:0:7487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1782756138.302531:0:7487:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782756138.302556:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c40030c00/0x5e4fb0a8aa198ae1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198ae8 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756138.302568:0:7487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c40030c00/0x5e4fb0a8aa198ae1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198ae8 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782756138.302618:0:7487:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1782756138.302621:0:7487:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d3c80977000 10000000:01000000:2.0:1782756138.302625:0:7487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d3c80977000 10000000:01000000:2.0:1782756138.302630:0:7487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782756138.302636:0:7487:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9d3c80977000 from 1 10000000:01000000:2.0:1782756138.302639:0:7487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782756138.302675:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198aef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756138.302698:0:7487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198aef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756138.302709:0:7487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198aef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756138.302745:0:7487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b604380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222580224:0@lo:101: 00000100:00100000:2.0:1782756138.302808:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756138.302854:0:7487:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c6dcdce40 going to sleep for 11 seconds 00000100:00100000:0.0:1782756138.302946:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222580224 00000100:00100000:0.0:1782756138.302954:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222580224 00000100:00100000:0.0:1782756138.303009:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1782756138.303019:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:7487:x1869355222580224:12345-0@lo:101: 00010000:00010000:0.0:1782756138.303034:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756138.303051:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c40031c00/0x5e4fb0a8aa198af6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198aef expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756138.303160:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c40031c00/0x5e4fb0a8aa198af6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198aef expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756138.303174:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c40031c00/0x5e4fb0a8aa198af6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198aef expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756138.303183:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c40031c00, rc 0) 00000100:00100000:0.0:1782756138.303230:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:7487:x1869355222580224:12345-0@lo:101: Request processed in 211us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756138.303237:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782756138.303504:0:7487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b604380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222580224:0@lo:101: 00010000:00010000:2.0:1782756138.303519:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198aef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198af6 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756138.303528:0:7487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198aef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198af6 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756138.303614:0:7487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b604380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222580352:0@lo:501: 00000100:00100000:2.0:1782756138.303643:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756138.303832:0:7487:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c6dcdce40 going to sleep for 11 seconds 00000100:00100000:1.0:1782756138.304353:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222580352 00000100:00100000:1.0:1782756138.304359:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222580352 00000100:00100000:1.0:1782756138.304391:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1782756138.304396:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:7487:x1869355222580352:12345-0@lo:501: 00000100:00100000:1.0:1782756138.304720:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:7487:x1869355222580352:12345-0@lo:501: Request processed in 323us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756138.304738:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1782756138.304814:0:7487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b604380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222580352:0@lo:501: 00000100:00100000:2.0:1782756138.304848:0:7487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b604380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222580480:0@lo:503: 00000100:00100000:2.0:1782756138.304954:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756138.304985:0:7487:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c6dcdce40 going to sleep for 11 seconds 00000100:00100000:0.0:1782756138.305029:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222580480 00000100:00100000:0.0:1782756138.305034:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222580480 00000100:00100000:0.0:1782756138.305064:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1782756138.305070:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:7487:x1869355222580480:12345-0@lo:503: 00000100:00100000:1.0:1782756138.305958:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:7487:x1869355222580480:12345-0@lo:503: Request processed in 886us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756138.305975:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1782756138.306101:0:7487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b604380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222580480:0@lo:503: 00000040:00080000:2.0:1782756138.306373:0:7487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782756138.306600:0:7487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b604380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222580608:0@lo:502: 00000100:00100000:2.0:1782756138.306644:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756138.306678:0:7487:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4663af00 going to sleep for 11 seconds 00000100:00100000:1.0:1782756138.306748:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222580608 00000100:00100000:1.0:1782756138.306754:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222580608 00000100:00100000:1.0:1782756138.306786:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782756138.306794:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:7487:x1869355222580608:12345-0@lo:502: 00000100:00100000:1.0:1782756138.307477:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:7487:x1869355222580608:12345-0@lo:502: Request processed in 682us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756138.307485:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1782756138.307548:0:7487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b604380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222580608:0@lo:502: 00000040:00080000:2.0:1782756138.307831:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1782756138.307937:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1782756138.307965:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1782756138.307999:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1782756138.308025:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1782756138.308058:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1782756138.308267:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1782756138.308318:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1782756138.308367:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1782756138.308490:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1782756138.308529:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1782756138.308579:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1782756138.308615:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1782756138.308649:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1782756138.308711:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1782756138.308766:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1782756138.308800:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1782756138.308846:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1782756138.308955:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1782756138.308988:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1782756138.309036:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1782756138.309220:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1782756138.309265:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1782756138.309330:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1782756138.309362:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1782756138.309388:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1782756138.309517:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1782756138.309565:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1782756138.309600:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1782756138.309651:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1782756138.309688:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1782756138.309738:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1782756138.309776:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1782756138.309825:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1782756138.309932:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1782756138.310019:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1782756138.310059:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1782756138.310243:0:7487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b604380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222580736:0@lo:502: 00000100:00100000:2.0:1782756138.310315:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756138.310360:0:7487:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4663af00 going to sleep for 11 seconds 00000100:00100000:1.0:1782756138.310495:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222580736 00000100:00100000:1.0:1782756138.310503:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222580736 00000100:00100000:1.0:1782756138.310548:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1782756138.310557:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:7487:x1869355222580736:12345-0@lo:502: 00000100:00100000:1.0:1782756138.310848:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:7487:x1869355222580736:12345-0@lo:502: Request processed in 291us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756138.310856:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782756138.310960:0:7487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b604380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222580736:0@lo:502: 00000040:00080000:3.0:1782756138.311037:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1782756138.311048:0:7487:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1782756138.314358:0:7499:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1782756138.314377:0:7499:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9d3c4aba0000) 00000020:00000080:1.0:1782756138.314401:0:7499:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1782756138.314885:0:7499:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3c80977000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1782756138.314889:0:7499:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d3c80977000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1782756138.314892:0:7499:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9d3c80977000 3 00010000:00080000:1.0:1782756138.314922:0:7499:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3b41d9d000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.125@tcp at head 00010000:00010000:1.0:1782756138.319605:0:7499:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1782756138.319794:0:7499:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1782756138.319841:0:7499:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782756138.319855:0:7499:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5e4fb0a8aa198b04 00000100:00080000:1.0:1782756138.319866:0:7499:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782756138.319875:0:7499:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d3b41d9d000 using connection 192.168.204.125@tcp/0@lo 00000100:00100000:1.0:1782756138.319912:0:7499:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3c80fcca80 x1869355222580864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782756138.319969:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1869355222580864:0@lo:38: 00000100:00100000:3.0:1782756138.320042:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756138.320168:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222580864 00000100:00100000:0.0:1782756138.320181:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222580864 00000100:00100000:0.0:1782756138.320213:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782756138.320220:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3313:x1869355222580864:12345-0@lo:38: 00010000:00080000:0.0:1782756138.320240:0:5804:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:0.0:1782756138.320268:0:5804:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5e4fb0a8aa198b0b 00000004:00100000:0.0:1782756138.320283:0:5804:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1782756138.320313:0:5804:0:(import.c:65:import_set_state_nolock()) ffff9d3c7fa78800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1782756138.320388:0:7499:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1782756138.320460:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869355222580992:0@lo:400: 00000100:00100000:1.0:1782756138.320487:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756138.320586:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869355222581120:0@lo:400: 00000100:00100000:1.0:1782756138.320609:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756138.320627:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782756138.320632:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222581248:0@lo:400: 00000100:00100000:1.0:1782756138.320781:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756138.320809:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222580992 00000100:00100000:1.0:1782756138.320813:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222580992 00000100:00100000:1.0:1782756138.320834:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222581120 00000100:00100000:1.0:1782756138.320836:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222581120 00000100:00100000:1.0:1782756138.320856:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782756138.320862:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869355222580992:12345-0@lo:400: 00000100:00100000:1.0:1782756138.320907:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869355222580992:12345-0@lo:400: Request processed in 45us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756138.320914:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782756138.320927:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782756138.320932:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869355222581120:12345-0@lo:400: 00000100:00100000:1.0:1782756138.320958:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869355222581120:12345-0@lo:400: Request processed in 25us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756138.320964:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782756138.320983:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222581248 00000100:00100000:1.0:1782756138.320991:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222581248 00000100:00100000:1.0:1782756138.321018:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782756138.321023:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222581248:12345-0@lo:400: 00000100:00100000:1.0:1782756138.321051:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222581248:12345-0@lo:400: Request processed in 28us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756138.321136:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1782756138.321151:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782756138.321155:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782756138.321179:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3c80fcf480 x1869355222580992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782756154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756138.321192:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869355222580992:0@lo:400: 00010000:00080000:1.0:1782756138.321214:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3c80fcf800 x1869355222581248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756138.321222:0:3316:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1782756138.321229:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222581248:0@lo:400: 00010000:00080000:1.0:1782756138.321237:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3c80fcf100 x1869355222581120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782756154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756138.321244:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869355222581120:0@lo:400: 00000040:00080000:1.0:1782756138.321451:0:7499:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1782756138.321708:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869355222580864:12345-0@lo:38: Request processed in 1486us (1664us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756138.321716:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1782756138.321877:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3c80fcca80 x1869355222580864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782756148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756138.321885:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782756138.321891:0:3313:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1782756138.321897:0:3313:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1782756138.321902:0:3313:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1782756138.321906:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9d3b41d9d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1782756138.321912:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1869355222580864:0@lo:38: 00000020:01000000:3.0:1782756138.321934:0:7487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1782756138.321959:0:7487:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782756138.321983:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198aef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198af6 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756138.321993:0:7487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198aef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198af6 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1782756138.322033:0:7487:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1782756138.322037:0:7487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782756138.322038:0:7487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782756138.322043:0:7487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782756138.322044:0:7487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782756138.322046:0:7487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782756138.322047:0:7487:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782756138.322048:0:7487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782756138.322049:0:7487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782756138.322051:0:7487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782756138.322052:0:7487:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782756138.322199:0:7487:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1782756138.322202:0:7487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782756138.322204:0:7487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782756138.322205:0:7487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782756138.322206:0:7487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782756138.322206:0:7487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782756138.322208:0:7487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782756138.322208:0:7487:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782756138.322209:0:7487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782756138.322210:0:7487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782756138.322211:0:7487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782756138.322212:0:7487:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782756138.322230:0:7487:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1782756138.322243:0:7487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78a31500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222581376:0@lo:253: 00000100:00100000:3.0:1782756138.322300:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756138.322331:0:7487:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a04b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782756138.322384:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222581376 00000100:00100000:0.0:1782756138.322390:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222581376 00000100:00100000:0.0:1782756138.322425:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1782756138.322432:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:7487:x1869355222581376:12345-0@lo:253: 20000000:01000000:0.0:1782756138.322453:0:5796:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1782756138.322466:0:5796:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1782756138.323252:0:7501:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f6300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7501:1869355222581504:0@lo:901: 00000100:00100000:0.0:1782756138.323293:0:7501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756138.323316:0:7501:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76f31180 going to sleep for 11 seconds 00000100:00100000:3.0:1782756138.323379:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222581504 00000100:00100000:3.0:1782756138.323383:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222581504 00000100:00100000:3.0:1782756138.323430:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782756138.323437:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c809f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7501:x1869355222581504:12345-0@lo:901: 00000100:00100000:3.0:1782756138.323892:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c809f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7501:x1869355222581504:12345-0@lo:901: Request processed in 454us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756138.323901:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1782756138.323951:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782756138.323981:0:7501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3c809f6300 x1869355222581504/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1782756154 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756138.323994:0:7501:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f6300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7501:1869355222581504:0@lo:901: 20000000:01000000:0.0:1782756138.357465:0:5796:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1782756138.357510:0:5796:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1782756138.358050:0:5819:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1782756138.358057:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1782756138.358312:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d3c4168d000/0x5e4fb0a8aa198b12 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756138.358350:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c41530200/0x5e4fb0a8aa198a55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198a4e expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756138.358359:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d3c4168d000/0x5e4fb0a8aa198b12 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756138.358396:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c41530200/0x5e4fb0a8aa198a55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa198a4e expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756138.358409:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d3c41530200/0x5e4fb0a8aa198a55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a4e expref: 14 pid: 5796 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756138.358425:0:5819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78a30700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5819:1869355222581632:0@lo:104: 00000100:00100000:3.0:1782756138.358490:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756138.358614:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222581632 00000100:00100000:0.0:1782756138.358621:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222581632 00000100:00100000:0.0:1782756138.358688:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782756138.358697:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78a31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+3:5819:x1869355222581632:12345-0@lo:104: 00010000:00010000:0.0:1782756138.358710:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: ffff9d3c40030200/0x5e4fb0a8aa198a4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198a55 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756138.358776:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782756138.358782:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78a31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+3:5819:x1869355222581632:12345-0@lo:104: Request processed in 87us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756138.358789:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782756138.358976:0:5819:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c49170600 going to sleep for 11 seconds 00000100:00100000:3.0:1782756138.358997:0:5819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78a30700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5819:1869355222581632:0@lo:104: 00010000:00010000:3.0:1782756138.359015:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d3c4168d000/0x5e4fb0a8aa198b12 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.359101:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782756138.359109:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c40030200/0x5e4fb0a8aa198a4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198a55 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.359117:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c40030200 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:1.0:1782756138.359121:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c40030200/0x5e4fb0a8aa198a4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa198a55 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.359140:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c40030200/0x5e4fb0a8aa198a4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa198a55 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782756138.359149:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c40030200/0x5e4fb0a8aa198a4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa198a55 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756138.359155:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782756138.359182:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c40030200/0x5e4fb0a8aa198a4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198a55 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.359188:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782756138.359236:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1782756138.359302:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c40030200/0x5e4fb0a8aa198a4e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198a55 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.359311:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c40030200/0x5e4fb0a8aa198a4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198a55 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.359330:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756138.359332:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756138.359334:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782756138.361701:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0daec403-69b6-4c98-a0ea-f519ca0a480f:3315:1869355222581760:0@lo:103: 00000100:00100000:3.0:1782756138.361783:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756138.361937:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222581760 00000100:00100000:1.0:1782756138.361948:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222581760 00010000:00010000:1.0:1782756138.361987:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c41530200/0x5e4fb0a8aa198a55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a4e expref: 15 pid: 5796 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756138.362024:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782756138.362033:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aa18850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:3315:x1869355222581760:12345-0@lo:103: 00010000:00010000:1.0:1782756138.362046:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756138.362051:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c41530200/0x5e4fb0a8aa198a55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a4e expref: 15 pid: 5796 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.362106:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c41530200/0x5e4fb0a8aa198a55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a4e expref: 15 pid: 5796 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.362123:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c41530200/0x5e4fb0a8aa198a55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a4e expref: 15 pid: 5796 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.362139:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d3c4168d000/0x5e4fb0a8aa198b12 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.362148:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4168d000/0x5e4fb0a8aa198b12 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782756138.362163:0:5788:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004107473s 00010000:00010000:1.0:1782756138.362168:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3c4168d000/0x5e4fb0a8aa198b12 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.362173:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3c4168d000/0x5e4fb0a8aa198b12 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.362179:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d3c4168d000/0x5e4fb0a8aa198b12 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.362184:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d3c4168d000/0x5e4fb0a8aa198b12 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.362189:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168d000 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:1.0:1782756138.362193:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d3c4168d000/0x5e4fb0a8aa198b12 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.362201:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d3c4168d000/0x5e4fb0a8aa198b12 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.362222:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d3c4168d000/0x5e4fb0a8aa198b12 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756138.362231:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782756138.362271:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aa18850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:3315:x1869355222581760:12345-0@lo:103: Request processed in 238us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756138.362278:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782756138.362340:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0daec403-69b6-4c98-a0ea-f519ca0a480f:3315:1869355222581760:0@lo:103: 00010000:00010000:0.0:1782756138.362405:0:5819:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d3c4168d000/0x5e4fb0a8aa198b12 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756138.362414:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d3c4168d000/0x5e4fb0a8aa198b12 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756138.362421:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4168d000/0x5e4fb0a8aa198b12 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756138.368114:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:7487:x1869355222581376:12345-0@lo:253: Request processed in 45672us (45804us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756138.368130:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1782756138.368334:0:7487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78a31500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0daec403-69b6-4c98-a0ea-f519ca0a480f:7487:1869355222581376:0@lo:253: 10000000:01000000:0.0:1782756138.368349:0:7487:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1782756138.368352:0:7487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782756138.368354:0:7487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782756138.368356:0:7487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782756138.368357:0:7487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782756138.368358:0:7487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782756138.368359:0:7487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782756138.368360:0:7487:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782756138.368362:0:7487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782756138.368363:0:7487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782756138.368365:0:7487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782756138.368366:0:7487:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1782756138.368383:0:7487:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1782756138.373851:0:7487:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1782756138.374036:0:7487:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1782756138.374339:0:7487:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1782756138.374505:0:7487:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1782756138.374934:0:7487:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1782756138.375284:0:7487:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1782756138.376423:0:7487:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1782756138.445750:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1782756138.599961:0:7487:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1782756138.599985:0:7487:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1782756138.600030:0:7487:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1782756138.600124:0:7487:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.125@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1782756138.600145:0:7487:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1782756138.600175:0:7487:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:1.0:1782756138.956961:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222581888:0@lo:13: 00000100:00100000:1.0:1782756138.957031:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756138.957215:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222581888 00000100:00100000:3.0:1782756138.957237:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222581888 00000100:00100000:3.0:1782756138.957291:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782756138.957300:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222581888:12345-0@lo:13: 00002000:00000024:3.0:1782756138.957335:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782756138.957397:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222581888:12345-0@lo:13: Request processed in 97us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756138.957404:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1782756138.957606:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c78a30700 x1869355222581888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756154 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756138.957626:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222581888:0@lo:13: 00010000:00010000:0.0:1782756139.473153:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756140.492191:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756141.517673:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756142.541505:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782756143.519360:0:7842:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1782756143.564278:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782756143.567335:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869355222582144:0@lo:400: 00000100:00100000:3.0:1782756143.567406:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756143.567459:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1782756143.567466:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222582016:0@lo:400: 00000100:00100000:3.0:1782756143.567494:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756143.567516:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869355222582528:0@lo:400: 00000100:00100000:3.0:1782756143.567535:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756143.567560:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222582272:0@lo:400: 00000100:00100000:3.0:1782756143.567583:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756143.567598:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782756143.567603:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222582400:0@lo:400: 00000100:00100000:3.0:1782756143.567638:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756143.567670:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222582144 00000100:00100000:3.0:1782756143.567678:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222582144 00000100:00100000:3.0:1782756143.567717:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222582528 00000100:00100000:3.0:1782756143.567719:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222582528 00000100:00100000:3.0:1782756143.567735:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222582272 00000100:00100000:3.0:1782756143.567738:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222582272 00000100:00100000:3.0:1782756143.567760:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782756143.567767:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869355222582144:12345-0@lo:400: 00000100:00100000:3.0:1782756143.567820:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869355222582144:12345-0@lo:400: Request processed in 53us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756143.567826:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782756143.567840:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782756143.567846:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869355222582528:12345-0@lo:400: 00000100:00100000:3.0:1782756143.567871:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869355222582528:12345-0@lo:400: Request processed in 25us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756143.567877:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782756143.567887:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782756143.567893:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222582272:12345-0@lo:400: 00000100:00100000:3.0:1782756143.567927:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222582272:12345-0@lo:400: Request processed in 33us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756143.567932:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782756143.567950:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222582400 00000100:00100000:3.0:1782756143.567954:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222582400 00000100:00100000:3.0:1782756143.567979:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782756143.567984:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78a33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222582400:12345-0@lo:400: 00000100:00100000:3.0:1782756143.568009:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78a33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222582400:12345-0@lo:400: Request processed in 26us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756143.568015:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1782756143.568046:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c78a32d80 x1869355222582400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756143.568060:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222582400:0@lo:400: 00010000:00080000:3.0:1782756143.568069:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c78a31500 x1869355222582272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782756159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756143.568104:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222582272:0@lo:400: 00000100:00100000:1.0:1782756143.568117:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222582016 00000100:00100000:1.0:1782756143.568121:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222582016 00000100:00100000:1.0:1782756143.568148:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1782756143.568155:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:3317:x1869355222582016:12345-0@lo:400: 00000100:00100000:1.0:1782756143.568187:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:3317:x1869355222582016:12345-0@lo:400: Request processed in 33us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756143.568199:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1782756143.568308:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782756143.568312:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782756143.568860:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222582016:0@lo:400: 00010000:00080000:3.0:1782756143.568878:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c78a33800 x1869355222582528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782756159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756143.568888:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869355222582528:0@lo:400: 00010000:00080000:3.0:1782756143.568896:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c78a30700 x1869355222582144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782756159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756143.568904:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869355222582144:0@lo:400: 00000100:00100000:3.0:1782756144.076320:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782756144.076347:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222582656:0@lo:13: 00000100:00100000:3.0:1782756144.076414:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756144.076478:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222582656 00000100:00100000:3.0:1782756144.076486:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222582656 00000100:00100000:3.0:1782756144.076549:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782756144.076558:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78a33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222582656:12345-0@lo:13: 00002000:00000024:3.0:1782756144.076590:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782756144.076644:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78a33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222582656:12345-0@lo:13: Request processed in 86us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756144.076651:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1782756144.076695:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c78a30700 x1869355222582656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756160 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756144.076714:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222582656:0@lo:13: 00010000:00010000:1.0:1782756144.589978:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756145.612562:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782756145.614239:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782756145.614247:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9d3c4a734800 from 30 10000000:01000000:0.0:1782756145.614253:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782756145.614303:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c40030000/0x5e4fb0a8aa198b19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756145.614314:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c40030000/0x5e4fb0a8aa198b19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756145.614325:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c40030000/0x5e4fb0a8aa198b19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756145.614349:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222582784:0@lo:101: 00000100:00100000:0.0:1782756145.614422:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756145.614501:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a04bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1782756145.614524:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222582784 00000100:00100000:3.0:1782756145.614534:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222582784 00000100:00100000:3.0:1782756145.614592:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1782756145.614603:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:5800:x1869355222582784:12345-0@lo:101: 00010000:00010000:3.0:1782756145.614617:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756145.614631:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4168d000/0x5e4fb0a8aa198b20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198b19 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756145.614656:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4168d000/0x5e4fb0a8aa198b20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198b19 expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756145.614678:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4168d000/0x5e4fb0a8aa198b20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198b19 expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756145.614687:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168d000, rc 0) 00000100:00100000:3.0:1782756145.614736:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:5800:x1869355222582784:12345-0@lo:101: Request processed in 134us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756145.614743:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1782756145.615241:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222582784:0@lo:101: 00010000:00010000:0.0:1782756145.615257:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c40030000/0x5e4fb0a8aa198b19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198b20 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756145.615266:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c40030000/0x5e4fb0a8aa198b19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198b20 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756145.615319:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222582912:0@lo:501: 00000100:00100000:0.0:1782756145.615361:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756145.615390:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a04bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1782756145.617222:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222582912 00000100:00100000:3.0:1782756145.617234:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222582912 00000100:00100000:3.0:1782756145.617298:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1782756145.617307:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:5800:x1869355222582912:12345-0@lo:501: 00000100:00100000:3.0:1782756145.617695:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:5800:x1869355222582912:12345-0@lo:501: Request processed in 388us (2332us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756145.617703:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1782756145.618053:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222582912:0@lo:501: 00000100:00100000:0.0:1782756145.618137:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222583040:0@lo:503: 00000100:00100000:0.0:1782756145.618196:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756145.618229:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a04bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1782756145.618382:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222583040 00000100:00100000:3.0:1782756145.618388:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222583040 00000100:00100000:3.0:1782756145.618427:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1782756145.618435:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:5800:x1869355222583040:12345-0@lo:503: 00000100:00100000:3.0:1782756145.618800:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:5800:x1869355222583040:12345-0@lo:503: Request processed in 366us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756145.618806:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1782756145.620859:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222583040:0@lo:503: 00000100:00100000:1.0:1782756145.621577:0:7947:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fcd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:7947:1869355222583168:0@lo:502: 00000100:00100000:1.0:1782756145.621660:0:7947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756145.621755:0:7947:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3b4116f000 going to sleep for 11 seconds 00000100:00100000:2.0:1782756145.622562:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222583168 00000100:00100000:2.0:1782756145.622571:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222583168 00000100:00100000:2.0:1782756145.622662:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782756145.622671:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:7947:x1869355222583168:12345-0@lo:502: 00000100:00100000:2.0:1782756145.623004:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:7947:x1869355222583168:12345-0@lo:502: Request processed in 333us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756145.623012:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1782756145.623315:0:7947:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fcd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:7947:1869355222583168:0@lo:502: 00000100:00100000:1.0:1782756145.623376:0:7947:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fcd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:7947:1869355222583296:0@lo:502: 00000100:00100000:1.0:1782756145.623420:0:7947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756145.623502:0:7947:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3b4116f000 going to sleep for 11 seconds 00000100:00100000:0.0:1782756145.626033:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222583296 00000100:00100000:0.0:1782756145.626048:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222583296 00000100:00100000:0.0:1782756145.626209:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1782756145.626220:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:7947:x1869355222583296:12345-0@lo:502: 00000100:00100000:0.0:1782756145.626595:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:7947:x1869355222583296:12345-0@lo:502: Request processed in 376us (3173us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756145.626603:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782756145.626714:0:7947:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fcd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:7947:1869355222583296:0@lo:502: 00000040:00080000:1.0:1782756145.626760:0:7947:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1782756145.627490:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1782756145.627515:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782756145.627528:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c40030000/0x5e4fb0a8aa198b19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198b20 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756145.627540:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c40030000/0x5e4fb0a8aa198b19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198b20 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782756145.627564:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1782756145.627567:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1782756145.627569:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1782756145.627611:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41530800/0x5e4fb0a8aa198b27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756145.627619:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c41530800/0x5e4fb0a8aa198b27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756145.627627:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c41530800/0x5e4fb0a8aa198b27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756145.627648:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b606d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222583424:0@lo:101: 00000100:00100000:2.0:1782756145.627696:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756145.627734:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a176480 going to sleep for 11 seconds 00000100:00100000:1.0:1782756145.627786:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222583424 00000100:00100000:1.0:1782756145.627792:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222583424 00000100:00100000:1.0:1782756145.627837:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782756145.627845:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:5800:x1869355222583424:12345-0@lo:101: 00010000:00010000:1.0:1782756145.627857:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756145.627870:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c41497c00/0x5e4fb0a8aa198b2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198b27 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756145.627894:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c41497c00/0x5e4fb0a8aa198b2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198b27 expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756145.627904:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c41497c00/0x5e4fb0a8aa198b2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198b27 expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756145.627923:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41497c00, rc 0) 00000100:00100000:1.0:1782756145.627967:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:5800:x1869355222583424:12345-0@lo:101: Request processed in 122us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756145.627974:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1782756145.628046:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b606d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222583424:0@lo:101: 00010000:00010000:2.0:1782756145.628059:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c41530800/0x5e4fb0a8aa198b27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198b2e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756145.628068:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c41530800/0x5e4fb0a8aa198b27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198b2e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756145.628153:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b606d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222583552:0@lo:501: 00000100:00100000:2.0:1782756145.628294:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756145.628324:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a176480 going to sleep for 11 seconds 00000100:00100000:0.0:1782756145.628384:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222583552 00000100:00100000:0.0:1782756145.628389:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222583552 00000100:00100000:0.0:1782756145.628417:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1782756145.628424:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:5800:x1869355222583552:12345-0@lo:501: 00000100:00100000:0.0:1782756145.628729:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:5800:x1869355222583552:12345-0@lo:501: Request processed in 304us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756145.628736:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1782756145.629030:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b606d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222583552:0@lo:501: 00000100:00100000:2.0:1782756145.629061:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b606d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222583680:0@lo:503: 00000100:00100000:2.0:1782756145.629309:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756145.629340:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a176480 going to sleep for 11 seconds 00000100:00100000:3.0:1782756145.629394:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222583680 00000100:00100000:3.0:1782756145.629399:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222583680 00000100:00100000:3.0:1782756145.629469:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1782756145.629477:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:5800:x1869355222583680:12345-0@lo:503: 00000100:00100000:3.0:1782756145.629788:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:5800:x1869355222583680:12345-0@lo:503: Request processed in 312us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756145.629795:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1782756145.629860:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b606d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222583680:0@lo:503: 00000100:00100000:2.0:1782756145.630251:0:7948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b606d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:7948:1869355222583808:0@lo:502: 00000100:00100000:2.0:1782756145.630286:0:7948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756145.630474:0:7948:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a176e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782756145.630535:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222583808 00000100:00100000:0.0:1782756145.630539:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222583808 00000100:00100000:0.0:1782756145.630560:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782756145.630566:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:7948:x1869355222583808:12345-0@lo:502: 00000100:00100000:0.0:1782756145.630754:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:7948:x1869355222583808:12345-0@lo:502: Request processed in 186us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756145.630770:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1782756145.630857:0:7948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b606d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:7948:1869355222583808:0@lo:502: 00000020:01000000:2.0:1782756145.630879:0:7948:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782756145.630887:0:7948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756145.630889:0:7948:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782756145.630895:0:7948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782756145.630896:0:7948:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1782756145.630910:0:7948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b606d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:7948:1869355222583936:0@lo:502: 00000100:00100000:2.0:1782756145.630942:0:7948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756145.630966:0:7948:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a176e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782756145.631014:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222583936 00000100:00100000:0.0:1782756145.631018:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222583936 00000100:00100000:0.0:1782756145.631035:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1782756145.631041:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:7948:x1869355222583936:12345-0@lo:502: 00000100:00100000:0.0:1782756145.631198:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:7948:x1869355222583936:12345-0@lo:502: Request processed in 155us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756145.631204:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1782756145.631338:0:7948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b606d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:7948:1869355222583936:0@lo:502: 00000020:01000000:2.0:1782756145.631355:0:7948:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782756145.631360:0:7948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756145.631361:0:7948:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1782756145.631365:0:7948:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1782756145.631510:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1782756145.631529:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1782756145.631541:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41530800/0x5e4fb0a8aa198b27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198b2e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756145.631551:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c41530800/0x5e4fb0a8aa198b27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198b2e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782756145.631560:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782756145.631562:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9d3c4505a800 from 30 10000000:01000000:0.0:1782756145.631565:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782756145.631597:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c40030200/0x5e4fb0a8aa198b35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756145.631605:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c40030200/0x5e4fb0a8aa198b35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756145.631613:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c40030200/0x5e4fb0a8aa198b35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756145.631625:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222584064:0@lo:101: 00000100:00100000:0.0:1782756145.631656:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756145.631689:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a04bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1782756145.631794:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222584064 00000100:00100000:2.0:1782756145.631799:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222584064 00000100:00100000:2.0:1782756145.631818:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1782756145.631824:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:5800:x1869355222584064:12345-0@lo:101: 00010000:00010000:2.0:1782756145.631832:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756145.631842:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c41530200/0x5e4fb0a8aa198b3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198b35 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756145.631868:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c41530200/0x5e4fb0a8aa198b3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198b35 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756145.631876:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c41530200/0x5e4fb0a8aa198b3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198b35 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756145.631884:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41530200, rc 0) 00000100:00100000:2.0:1782756145.631920:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:5800:x1869355222584064:12345-0@lo:101: Request processed in 96us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756145.631925:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1782756145.631981:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222584064:0@lo:101: 00010000:00010000:0.0:1782756145.631992:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c40030200/0x5e4fb0a8aa198b35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198b3c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756145.632001:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c40030200/0x5e4fb0a8aa198b35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198b3c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756145.632036:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222584192:0@lo:501: 00000100:00100000:0.0:1782756145.632057:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756145.632105:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a04bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1782756145.632214:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222584192 00000100:00100000:2.0:1782756145.632218:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222584192 00000100:00100000:2.0:1782756145.632235:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1782756145.632240:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:5800:x1869355222584192:12345-0@lo:501: 00000100:00100000:2.0:1782756145.632458:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:5800:x1869355222584192:12345-0@lo:501: Request processed in 217us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756145.632465:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1782756145.632597:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222584192:0@lo:501: 00000100:00100000:0.0:1782756145.632622:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222584320:0@lo:503: 00000100:00100000:0.0:1782756145.632653:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756145.632680:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a04bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1782756145.632724:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222584320 00000100:00100000:2.0:1782756145.632728:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222584320 00000100:00100000:2.0:1782756145.632747:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1782756145.632752:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:5800:x1869355222584320:12345-0@lo:503: 00000100:00100000:2.0:1782756145.632887:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:5800:x1869355222584320:12345-0@lo:503: Request processed in 134us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756145.632894:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1782756145.632959:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222584320:0@lo:503: 00000100:00100000:0.0:1782756145.633507:0:7949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:7949:1869355222584448:0@lo:502: 00000100:00100000:0.0:1782756145.633549:0:7949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756145.633577:0:7949:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a04b780 going to sleep for 11 seconds 00000100:00100000:2.0:1782756145.633631:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222584448 00000100:00100000:2.0:1782756145.633636:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222584448 00000100:00100000:2.0:1782756145.633656:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1782756145.633671:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:7949:x1869355222584448:12345-0@lo:502: 00000100:00100000:2.0:1782756145.633838:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:7949:x1869355222584448:12345-0@lo:502: Request processed in 167us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756145.633844:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1782756145.633909:0:7949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:7949:1869355222584448:0@lo:502: 00000100:00100000:0.0:1782756145.633946:0:7949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:7949:1869355222584576:0@lo:502: 00000100:00100000:0.0:1782756145.633972:0:7949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756145.633990:0:7949:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a04b780 going to sleep for 11 seconds 00000100:00100000:2.0:1782756145.634032:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222584576 00000100:00100000:2.0:1782756145.634036:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222584576 00000100:00100000:2.0:1782756145.634051:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1782756145.634055:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:7949:x1869355222584576:12345-0@lo:502: 00000100:00100000:2.0:1782756145.634361:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:7949:x1869355222584576:12345-0@lo:502: Request processed in 303us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756145.634368:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1782756145.634432:0:7949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:7949:1869355222584576:0@lo:502: 00000040:00080000:0.0:1782756145.634453:0:7949:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1782756145.634789:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1782756145.634808:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782756145.634818:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c40030200/0x5e4fb0a8aa198b35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198b3c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756145.634828:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c40030200/0x5e4fb0a8aa198b35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198b3c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782756145.634837:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782756145.634840:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9d3c4505a800 from 5 10000000:01000000:2.0:1782756145.634842:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782756145.634869:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41531400/0x5e4fb0a8aa198b43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756145.634877:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c41531400/0x5e4fb0a8aa198b43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756145.634887:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c41531400/0x5e4fb0a8aa198b43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756145.634908:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b606d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222584704:0@lo:101: 00000100:00100000:2.0:1782756145.634938:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756145.634971:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a176300 going to sleep for 11 seconds 00000100:00100000:0.0:1782756145.635015:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222584704 00000100:00100000:0.0:1782756145.635019:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222584704 00000100:00100000:0.0:1782756145.635040:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1782756145.635046:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:5800:x1869355222584704:12345-0@lo:101: 00010000:00010000:0.0:1782756145.635055:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756145.635067:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c40031600/0x5e4fb0a8aa198b4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198b43 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756145.635120:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c40031600/0x5e4fb0a8aa198b4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198b43 expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756145.635131:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c40031600/0x5e4fb0a8aa198b4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198b43 expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756145.635139:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c40031600, rc 0) 00000100:00100000:0.0:1782756145.635172:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:5800:x1869355222584704:12345-0@lo:101: Request processed in 126us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756145.635188:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1782756145.635358:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b606d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222584704:0@lo:101: 00010000:00010000:2.0:1782756145.635370:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c41531400/0x5e4fb0a8aa198b43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198b4a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756145.635379:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c41531400/0x5e4fb0a8aa198b43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198b4a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756145.635433:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b606d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222584832:0@lo:256: 00000100:00100000:2.0:1782756145.635466:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756145.635481:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a176300 going to sleep for 11 seconds 00000100:00100000:3.0:1782756145.635534:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222584832 00000100:00100000:3.0:1782756145.635538:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222584832 00000100:00100000:3.0:1782756145.635560:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1782756145.635566:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:5800:x1869355222584832:12345-0@lo:256: 20000000:01000000:3.0:1782756145.635578:0:5796:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1782756145.635607:0:5796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1782756145.635610:0:5796:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1782756145.635697:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:5800:x1869355222584832:12345-0@lo:256: Request processed in 130us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756145.635703:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1782756145.635769:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b606d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222584832:0@lo:256: 10000000:01000000:2.0:1782756145.635807:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782756145.635813:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41531400/0x5e4fb0a8aa198b43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198b4a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756145.635820:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c41531400/0x5e4fb0a8aa198b43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198b4a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782756145.635827:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1782756145.635829:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1782756145.635832:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1782756145.635848:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198b51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756145.635865:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198b51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756145.635873:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198b51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756145.635885:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b606d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222584960:0@lo:101: 00000100:00100000:2.0:1782756145.635908:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756145.635928:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a700c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782756145.635974:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222584960 00000100:00100000:3.0:1782756145.635978:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222584960 00000100:00100000:3.0:1782756145.635993:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1782756145.635998:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:5800:x1869355222584960:12345-0@lo:101: 00010000:00010000:3.0:1782756145.636004:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756145.636015:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa198b58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198b51 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756145.636038:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa198b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198b51 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756145.636046:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa198b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198b51 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756145.636053:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168c200, rc 0) 00000100:00100000:3.0:1782756145.636171:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:5800:x1869355222584960:12345-0@lo:101: Request processed in 172us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756145.636177:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1782756145.636380:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b606d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222584960:0@lo:101: 00010000:00010000:2.0:1782756145.636389:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198b51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198b58 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756145.636397:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198b51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198b58 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756145.636433:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b606d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222585088:0@lo:501: 00000100:00100000:2.0:1782756145.636454:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756145.636469:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a700c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782756145.636530:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222585088 00000100:00100000:0.0:1782756145.636534:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222585088 00000100:00100000:0.0:1782756145.636550:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1782756145.636555:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:5800:x1869355222585088:12345-0@lo:501: 00000100:00100000:0.0:1782756145.636766:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:5800:x1869355222585088:12345-0@lo:501: Request processed in 210us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756145.636772:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1782756145.636896:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b606d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222585088:0@lo:501: 00000100:00100000:2.0:1782756145.636918:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b606d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222585216:0@lo:503: 00000100:00100000:2.0:1782756145.636950:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756145.636970:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a700c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782756145.637026:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222585216 00000100:00100000:3.0:1782756145.637030:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222585216 00000100:00100000:3.0:1782756145.637046:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1782756145.637051:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:5800:x1869355222585216:12345-0@lo:503: 00000100:00100000:3.0:1782756145.637447:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:5800:x1869355222585216:12345-0@lo:503: Request processed in 395us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756145.637454:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1782756145.637542:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b606d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222585216:0@lo:503: 00000100:00100000:2.0:1782756145.638029:0:7950:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b606d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:7950:1869355222585344:0@lo:502: 00000100:00100000:2.0:1782756145.638065:0:7950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756145.638270:0:7950:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a700600 going to sleep for 11 seconds 00000100:00100000:3.0:1782756145.638317:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222585344 00000100:00100000:3.0:1782756145.638321:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222585344 00000100:00100000:3.0:1782756145.638355:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782756145.638362:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:7950:x1869355222585344:12345-0@lo:502: 00000100:00100000:3.0:1782756145.638617:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:7950:x1869355222585344:12345-0@lo:502: Request processed in 254us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756145.638624:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1782756145.638727:0:7950:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b606d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:7950:1869355222585344:0@lo:502: 00000020:01000000:2.0:1782756145.638751:0:7950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782756145.638758:0:7950:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1782756145.638765:0:7950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756145.638767:0:7950:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1782756145.638773:0:7950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1782756145.638777:0:7950:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.125@tcp to nid 0x20000c0a8cc7d (192.168.204.125@tcp) 00000020:01000000:2.0:1782756145.638798:0:7950:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1782756145.638801:0:7950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782756145.638816:0:7950:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9d3c44d1b380) 00000020:00000080:2.0:1782756145.638837:0:7950:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1782756145.638843:0:7950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1782756145.638910:0:7950:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1782756145.638916:0:7950:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:2.0:1782756145.638924:0:7950:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5e4fb0a8aa198b66 00010000:00080000:2.0:1782756145.638962:0:7950:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3c5014a800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.125@tcp at head 00010000:00010000:2.0:1782756145.639392:0:7950:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1782756145.639717:0:7950:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1782756145.639730:0:7950:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1782756145.640644:0:7950:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782756145.640862:0:7950:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782756145.640914:0:7950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1782756145.640975:0:7950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1782756145.641843:0:7951:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782756145.641849:0:7951:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1782756145.642732:0:7950:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782756145.642747:0:7950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1782756145.642783:0:7950:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1782756145.642806:0:7950:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5e4fb0a8aa198b6d 00000100:00080000:2.0:1782756145.642818:0:7950:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782756145.642833:0:7950:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d3c5014a800 using connection 192.168.204.125@tcp/0@lo 00000100:00100000:2.0:1782756145.642871:0:7950:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3c4b606d80 x1869355222585472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782756145.642899:0:7950:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1782756145.642954:0:7950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782756145.642958:0:7950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756145.642961:0:7950:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1782756145.642963:0:7950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782756145.642967:0:7950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756145.642969:0:7950:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782756145.642972:0:7950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782756145.642973:0:7950:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1782756145.642999:0:7950:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b605180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:7950:1869355222585600:0@lo:502: 00000100:00100000:2.0:1782756145.643166:0:7950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756145.643264:0:7950:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a7000c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782756145.643326:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869355222585472:0@lo:8: 00000100:00100000:3.0:1782756145.643362:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756145.643419:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222585600 00000100:00100000:3.0:1782756145.643426:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222585600 00000100:00100000:3.0:1782756145.643467:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1782756145.643475:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:7950:x1869355222585600:12345-0@lo:502: 00000100:00100000:3.0:1782756145.643698:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:7950:x1869355222585600:12345-0@lo:502: Request processed in 222us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756145.643705:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1782756145.643885:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869355222586112:0@lo:400: 00000100:00100000:1.0:1782756145.643917:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756145.643936:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782756145.643941:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222585984:0@lo:400: 00000100:00100000:1.0:1782756145.643959:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756145.644017:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869355222585728:0@lo:400: 00000100:00100000:3.0:1782756145.644042:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756145.644068:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782756145.644326:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222585856:0@lo:400: 00000100:00100000:3.0:1782756145.644352:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756145.644383:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222586112 00000100:00100000:3.0:1782756145.644387:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222586112 00000100:00100000:3.0:1782756145.644421:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222585728 00000100:00100000:3.0:1782756145.644424:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222585728 00000100:00100000:3.0:1782756145.644435:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222585856 00000100:00100000:3.0:1782756145.644437:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222585856 00000100:00100000:3.0:1782756145.644450:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782756145.644456:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869355222586112:12345-0@lo:400: 00000100:00100000:3.0:1782756145.644497:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869355222586112:12345-0@lo:400: Request processed in 41us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756145.644504:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782756145.644519:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782756145.644525:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869355222585728:12345-0@lo:400: 00000100:00100000:3.0:1782756145.644557:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869355222585728:12345-0@lo:400: Request processed in 32us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756145.644562:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782756145.644596:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782756145.644602:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222585856:12345-0@lo:400: 00000100:00100000:3.0:1782756145.644629:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222585856:12345-0@lo:400: Request processed in 28us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756145.644635:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782756145.644652:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222585472 00000100:00100000:3.0:1782756145.644655:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222585472 00000100:00100000:3.0:1782756145.644672:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222585984 00000100:00100000:3.0:1782756145.644674:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222585984 00000100:00100000:3.0:1782756145.644692:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782756145.644699:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222585984:12345-0@lo:400: 00000100:00100000:3.0:1782756145.644726:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222585984:12345-0@lo:400: Request processed in 28us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756145.644732:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782756145.644742:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782756145.644746:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78a30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3313:x1869355222585472:12345-0@lo:8: 00010000:00080000:3.0:1782756145.644767:0:6603:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:3.0:1782756145.644792:0:6603:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5e4fb0a8aa198b74 00002000:00100000:3.0:1782756145.644806:0:6603:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9d3c77032800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1782756145.644811:0:6603:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1782756145.644814:0:6603:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1782756145.644935:0:6603:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1782756145.645237:0:7950:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b605180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:7950:1869355222585600:0@lo:502: 00000020:01000000:2.0:1782756145.645271:0:7950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782756145.645278:0:7950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756145.645280:0:7950:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1782756145.645284:0:7950:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00080000:1.0:1782756145.645509:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782756145.645513:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:3.0:1782756145.645561:0:6603:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1782756145.645595:0:6603:0:(import.c:65:import_set_state_nolock()) ffff9d3c77032000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782756145.645679:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78a30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1869355222585472:12345-0@lo:8: Request processed in 930us (2316us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756145.645686:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1782756145.645727:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c80fcc700 x1869355222585856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782756161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756145.645739:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222585856:0@lo:400: 00010000:00080000:3.0:1782756145.645752:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c80fcd500 x1869355222585728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782756161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756145.645761:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869355222585728:0@lo:400: 00010000:00080000:3.0:1782756145.645795:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c80fcd880 x1869355222585984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756145.645804:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222585984:0@lo:400: 00010000:00080000:3.0:1782756145.645815:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c80fcf800 x1869355222586112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782756161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756145.645822:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869355222586112:0@lo:400: 00000020:01000000:3.0:1782756145.645840:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1782756145.645860:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1782756145.645870:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198b51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198b58 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756145.645881:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198b58 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782756145.645890:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1782756145.645892:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9d3c4aba3380 from 1 10000000:01000000:3.0:1782756145.645894:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782756145.645917:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d200/0x5e4fb0a8aa198b7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756145.645933:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d200/0x5e4fb0a8aa198b7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756145.645942:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d200/0x5e4fb0a8aa198b7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756145.645958:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78a32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222586240:0@lo:101: 00000100:00100000:3.0:1782756145.645988:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756145.646024:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76f310c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782756145.646288:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222586240 00000100:00100000:2.0:1782756145.646294:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222586240 00000100:00100000:2.0:1782756145.646322:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1782756145.646330:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:5800:x1869355222586240:12345-0@lo:101: 00010000:00010000:2.0:1782756145.646339:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756145.646351:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c41531800/0x5e4fb0a8aa198b82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198b7b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756145.646370:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c41531800/0x5e4fb0a8aa198b82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198b7b expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756145.646387:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c41531800/0x5e4fb0a8aa198b82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198b7b expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756145.646395:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41531800, rc 0) 00000100:00100000:2.0:1782756145.646434:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:5800:x1869355222586240:12345-0@lo:101: Request processed in 105us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756145.646440:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1782756145.646501:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78a32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222586240:0@lo:101: 00010000:00010000:0.0:1782756145.646513:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d200/0x5e4fb0a8aa198b7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198b82 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756145.646527:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d200/0x5e4fb0a8aa198b7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198b82 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756145.646574:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222586368:0@lo:501: 00000100:00100000:0.0:1782756145.646609:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756145.646635:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a04bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1782756145.646670:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222586368 00000100:00100000:2.0:1782756145.646674:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222586368 00000100:00100000:2.0:1782756145.646704:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1782756145.646710:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:5800:x1869355222586368:12345-0@lo:501: 00000100:00100000:2.0:1782756145.646909:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:5800:x1869355222586368:12345-0@lo:501: Request processed in 198us (299us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782756145.646916:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782756145.646978:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222586368:0@lo:501: 10000000:01000000:0.0:1782756145.647000:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1782756145.647006:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d200/0x5e4fb0a8aa198b7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198b82 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756145.647014:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d200/0x5e4fb0a8aa198b7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198b82 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1782756145.647426:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c4b606d80 x1869355222585472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782756155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756145.647436:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782756145.647443:0:3313:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1782756145.647450:0:3313:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1782756145.647455:0:3313:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1782756145.647458:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9d3c5014a800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1782756145.647510:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1782756145.647515:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869355222585472:0@lo:8: 00000004:00080000:3.0:1782756145.647604:0:7951:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1782756145.647716:0:7951:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 186882640899ns, next at 0ns, rc = 0 00000004:00080000:3.0:1782756145.698118:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1782756145.699702:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222586496:0@lo:13: 00000100:00100000:3.0:1782756145.699773:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756145.699876:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222586496 00000100:00100000:0.0:1782756145.699883:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222586496 00000100:00100000:0.0:1782756145.699952:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782756145.699961:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78a31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1869355222586496:12345-0@lo:13: 00002000:00000024:0.0:1782756145.699993:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000004:00080000:1.0:1782756145.700049:0:7952:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1782756145.700096:0:7952:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fcd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7952:1869355222586624:0@lo:7: 00000100:00100000:1.0:1782756145.700125:0:7952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756145.700163:0:7952:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3b4116f900 going to sleep for 11 seconds 00000100:00100000:1.0:1782756145.700183:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222586624 00000100:00100000:1.0:1782756145.700188:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222586624 00000100:00100000:1.0:1782756145.700215:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782756145.700221:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7952:x1869355222586624:12345-0@lo:7: 00000100:00080000:2.0:1782756145.704767:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782756145.707319:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78a31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1869355222586496:12345-0@lo:13: Request processed in 7346us (7532us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756145.707339:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00002000:00080000:1.0:1782756145.708648:0:6602:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1782756145.708657:0:6602:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1782756145.708753:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7952:x1869355222586624:12345-0@lo:7: Request processed in 8528us (8623us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756145.708762:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1782756145.710107:0:7952:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c80fcd180 x1869355222586624/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782756161 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782756145.710123:0:7952:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fcd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7952:1869355222586624:0@lo:7: 00000004:00080000:2.0:1782756145.710137:0:7952:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1782756145.710181:0:7952:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b605180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7952:1869355222586752:0@lo:5: 00000100:00100000:2.0:1782756145.710226:0:7952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756145.710290:0:7952:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c6a2f6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782756145.710347:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222586752 00000100:00100000:0.0:1782756145.710355:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222586752 00000100:00100000:0.0:1782756145.710402:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782756145.710412:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4b606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7952:x1869355222586752:12345-0@lo:5: 00002000:00080000:0.0:1782756145.710451:0:6605:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1782756145.710455:0:6605:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1782756145.710772:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4b606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7952:x1869355222586752:12345-0@lo:5: Request processed in 361us (545us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1782756145.710780:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1782756145.710921:0:7952:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c4b605180 x1869355222586752/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782756161 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782756145.710932:0:7952:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b605180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7952:1869355222586752:0@lo:5: 00000004:00080000:2.0:1782756145.710948:0:7952:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00010000:00080000:3.0:1782756145.711694:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c80fce300 x1869355222586496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756161 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756145.711713:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222586496:0@lo:13: 00010000:00010000:1.0:1782756146.636349:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782756147.463450:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1782756147.463475:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1782756147.660170:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756147.796114:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756147.796345:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209982080 00000100:00100000:1.0:1782756147.796354:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209982080 00000100:00100000:1.0:1782756147.796390:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 108 00000100:00100000:1.0:1782756147.796397:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2354:x1869355209982080:12345-192.168.204.25@tcp:250: 00010000:00080000:1.0:1782756147.796424:0:5797:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from bbfeba57-ec56-49f1-8ea5-8df0e0e2db70@192.168.204.25@tcp t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:1.0:1782756147.796452:0:5797:0:(genops.c:1406:class_connect()) connect: client bbfeba57-ec56-49f1-8ea5-8df0e0e2db70, cookie 0x5e4fb0a8aa198b89 00000100:00080000:1.0:1782756147.796585:0:5797:0:(import.c:65:import_set_state_nolock()) ffff9d3b41d9a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782756147.796645:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+5:2354:x1869355209982080:12345-192.168.204.25@tcp:250: Request processed in 246us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756147.796653:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 108 00000100:00100000:2.0:1782756147.798318:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756147.798431:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209982208 00000100:00100000:0.0:1782756147.798439:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209982208 00000100:00100000:0.0:1782756147.798496:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 109 00000100:00100000:0.0:1782756147.798506:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+5:5566:x1869355209982208:12345-192.168.204.25@tcp:101: 00010000:00010000:0.0:1782756147.798519:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756147.798534:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4b81bc00/0x5e4fb0a8aa198b90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdd67 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756147.798571:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4b81bc00/0x5e4fb0a8aa198b90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdd67 expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756147.798584:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4b81bc00/0x5e4fb0a8aa198b90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdd67 expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756147.798593:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81bc00, rc 0) 00000100:00100000:0.0:1782756147.798643:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+6:5566:x1869355209982208:12345-192.168.204.25@tcp:101: Request processed in 139us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756147.798650:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 109 00000100:00100000:3.0:1782756147.806956:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756147.806997:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209982336 00000100:00100000:1.0:1782756147.807007:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209982336 00000100:00100000:1.0:1782756147.807062:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 110 00000100:00100000:1.0:1782756147.807106:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+6:5566:x1869355209982336:12345-192.168.204.25@tcp:501: 00000100:00100000:1.0:1782756147.807458:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+6:5566:x1869355209982336:12345-192.168.204.25@tcp:501: Request processed in 384us (508us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782756147.807475:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 110 00000100:00100000:1.0:1782756147.809865:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756147.809915:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209982464 00000100:00100000:2.0:1782756147.809924:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209982464 00000100:00100000:2.0:1782756147.809979:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 111 00000100:00100000:2.0:1782756147.809988:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+6:5566:x1869355209982464:12345-192.168.204.25@tcp:101: 00010000:00010000:2.0:1782756147.810003:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756147.810019:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4a63ce00/0x5e4fb0a8aa198b97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdd6e expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756147.810045:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4a63ce00/0x5e4fb0a8aa198b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdd6e expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756147.810057:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4a63ce00/0x5e4fb0a8aa198b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdd6e expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756147.810065:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63ce00, rc 0) 00000100:00100000:2.0:1782756147.810146:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+7:5566:x1869355209982464:12345-192.168.204.25@tcp:101: Request processed in 159us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756147.810153:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 111 00000100:00100000:1.0:1782756147.812613:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756147.812649:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209982592 00000100:00100000:1.0:1782756147.812656:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209982592 00000100:00100000:1.0:1782756147.812698:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 112 00000100:00100000:1.0:1782756147.812708:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+7:5566:x1869355209982592:12345-192.168.204.25@tcp:501: 00000100:00100000:1.0:1782756147.813583:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+8:5566:x1869355209982592:12345-192.168.204.25@tcp:501: Request processed in 870us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756147.813594:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 112 00000100:00100000:1.0:1782756147.816392:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756147.816739:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209982720 00000100:00100000:2.0:1782756147.816749:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209982720 00000100:00100000:2.0:1782756147.816791:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 113 00000100:00100000:2.0:1782756147.816799:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+8:5566:x1869355209982720:12345-192.168.204.25@tcp:503: 00000100:00100000:2.0:1782756147.817041:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+8:5566:x1869355209982720:12345-192.168.204.25@tcp:503: Request processed in 242us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756147.817049:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 113 00000100:00100000:2.0:1782756147.820151:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756147.820225:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209982848 00000100:00100000:1.0:1782756147.820233:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209982848 00000100:00100000:1.0:1782756147.820276:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 114 00000100:00100000:1.0:1782756147.820286:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+8:5584:x1869355209982848:12345-192.168.204.25@tcp:502: 00000100:00100000:1.0:1782756147.820595:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+8:5584:x1869355209982848:12345-192.168.204.25@tcp:502: Request processed in 310us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756147.820601:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 114 00000100:00100000:1.0:1782756147.839739:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756147.839775:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209982976 00000100:00100000:1.0:1782756147.839784:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209982976 00000100:00100000:1.0:1782756147.839839:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 115 00000100:00100000:1.0:1782756147.839850:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+8:5584:x1869355209982976:12345-192.168.204.25@tcp:502: 00000100:00100000:1.0:1782756147.840119:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+8:5584:x1869355209982976:12345-192.168.204.25@tcp:502: Request processed in 268us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756147.840139:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 115 00000100:00100000:3.0:1782756147.853917:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756147.854035:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209983104 00000100:00100000:1.0:1782756147.854049:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209983104 00000100:00100000:1.0:1782756147.854166:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 116 00000100:00100000:1.0:1782756147.854178:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+8:5566:x1869355209983104:12345-192.168.204.25@tcp:101: 00010000:00010000:1.0:1782756147.854242:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756147.854261:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c41496000/0x5e4fb0a8aa198b9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdd98 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756147.854290:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c41496000/0x5e4fb0a8aa198b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdd98 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756147.854303:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c41496000/0x5e4fb0a8aa198b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdd98 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756147.854313:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41496000, rc 0) 00000100:00100000:1.0:1782756147.854377:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+9:5566:x1869355209983104:12345-192.168.204.25@tcp:101: Request processed in 202us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756147.854385:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 116 00000100:00100000:0.0:1782756147.856940:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756147.857185:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209983232 00000100:00100000:2.0:1782756147.857195:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209983232 00000100:00100000:2.0:1782756147.857247:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 117 00000100:00100000:2.0:1782756147.857258:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+9:5566:x1869355209983232:12345-192.168.204.25@tcp:256: 20000000:01000000:2.0:1782756147.857281:0:5798:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1782756147.857304:0:5798:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1782756147.857309:0:5798:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1782756147.857312:0:5798:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1782756147.857315:0:5798:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1782756147.861807:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+9:5566:x1869355209983232:12345-192.168.204.25@tcp:256: Request processed in 4542us (4865us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756147.861823:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 117 00000100:00100000:1.0:1782756147.867242:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756147.867478:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209983360 00000100:00100000:3.0:1782756147.867486:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209983360 00000100:00100000:3.0:1782756147.867531:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 118 00000100:00100000:3.0:1782756147.867553:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+9:5566:x1869355209983360:12345-192.168.204.25@tcp:101: 00010000:00010000:3.0:1782756147.867570:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756147.867587:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa198ba5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdd9f expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756147.867623:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa198ba5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdd9f expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756147.867635:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa198ba5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdd9f expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756147.867645:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168d600, rc 0) 00000100:00100000:3.0:1782756147.867708:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:5566:x1869355209983360:12345-192.168.204.25@tcp:101: Request processed in 157us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756147.867716:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 118 00000100:00100000:0.0:1782756147.869687:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756147.869783:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209983488 00000100:00100000:1.0:1782756147.869793:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209983488 00000100:00100000:1.0:1782756147.869884:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 119 00000100:00100000:1.0:1782756147.869894:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:5566:x1869355209983488:12345-192.168.204.25@tcp:501: 00000100:00100000:1.0:1782756147.870127:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:5566:x1869355209983488:12345-192.168.204.25@tcp:501: Request processed in 234us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756147.870135:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 119 00000100:00100000:2.0:1782756147.874346:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756147.874442:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209983616 00000100:00100000:3.0:1782756147.874452:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209983616 00000100:00100000:0.0:1782756147.874578:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 120 00000100:00100000:0.0:1782756147.874600:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:5566:x1869355209983616:12345-192.168.204.25@tcp:503: 00000100:00100000:0.0:1782756147.875137:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:5566:x1869355209983616:12345-192.168.204.25@tcp:503: Request processed in 539us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756147.875148:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 120 00000100:00100000:1.0:1782756147.879651:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756147.879744:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209983744 00000100:00100000:0.0:1782756147.879754:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209983744 00000100:00100000:0.0:1782756147.879931:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 121 00000100:00100000:0.0:1782756147.879944:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:5587:x1869355209983744:12345-192.168.204.25@tcp:502: 00000100:00100000:0.0:1782756147.880234:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:5587:x1869355209983744:12345-192.168.204.25@tcp:502: Request processed in 292us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756147.880648:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 121 00000100:00100000:2.0:1782756147.882373:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756147.882425:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209983872 00000100:00100000:0.0:1782756147.882435:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209983872 00000100:00100000:0.0:1782756147.882498:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 122 00000100:00100000:0.0:1782756147.882510:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:5587:x1869355209983872:12345-192.168.204.25@tcp:502: 00000100:00100000:0.0:1782756147.882737:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:5587:x1869355209983872:12345-192.168.204.25@tcp:502: Request processed in 229us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756147.882749:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 122 00000100:00100000:2.0:1782756147.887655:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756147.887699:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209984000 00000100:00100000:3.0:1782756147.887715:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209984000 00000100:00100000:3.0:1782756147.887788:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 4 00000100:00100000:3.0:1782756147.887799:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4b604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2354:x1869355209984000:12345-192.168.204.25@tcp:38: 00010000:00080000:3.0:1782756147.887838:0:5805:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 26487635-60cb-4aee-af8e-396654f6c3d8@192.168.204.25@tcp t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:3.0:1782756147.887917:0:5805:0:(genops.c:1406:class_connect()) connect: client 26487635-60cb-4aee-af8e-396654f6c3d8, cookie 0x5e4fb0a8aa198bac 00000004:00100000:3.0:1782756147.887958:0:5805:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1782756147.888325:0:5805:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1782756147.911004:0:5805:0:(import.c:65:import_set_state_nolock()) ffff9d3c7fa7a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782756147.911169:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4b604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+6:2354:x1869355209984000:12345-192.168.204.25@tcp:38: Request processed in 23365us (23537us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756147.911182:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 4 00010000:00010000:1.0:1782756148.685221:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756148.916643:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756148.916785:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756148.918049:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209984128 00000100:00100000:2.0:1782756148.918052:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209984256 00000100:00100000:2.0:1782756148.918071:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209984256 00000100:00100000:0.0:1782756148.918175:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209984128 00000100:00080000:1.0:1782756148.918297:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782756148.918340:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5 00000100:00100000:2.0:1782756148.918352:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+7:5566:x1869355209984256:12345-192.168.204.25@tcp:41: 00000004:00000024:2.0:1782756148.918412:0:5803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1782756148.918499:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+7:5566:x1869355209984256:12345-192.168.204.25@tcp:41: Request processed in 150us (1713us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756148.918507:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5 00000100:00100000:0.0:1782756148.919205:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6 00000100:00100000:0.0:1782756148.919234:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+6:0:x1869355209984128:12345-192.168.204.25@tcp:41: 00000004:00000024:0.0:1782756148.919291:0:5804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1782756148.919370:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+6:0:x1869355209984128:12345-192.168.204.25@tcp:41: Request processed in 152us (2741us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756148.919379:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6 00000100:00100000:1.0:1782756148.920708:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756148.920809:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209984384 00000100:00100000:2.0:1782756148.920883:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209984384 00000100:00100000:2.0:1782756148.920944:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7 00000100:00100000:2.0:1782756148.920953:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+6:5566:x1869355209984384:12345-192.168.204.25@tcp:40: 00000100:00100000:2.0:1782756148.921101:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+6:5566:x1869355209984384:12345-192.168.204.25@tcp:40: Request processed in 148us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756148.921126:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7 00000100:00100000:2.0:1782756148.923306:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756148.923704:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209984512 00000100:00100000:1.0:1782756148.923716:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209984512 00000100:00100000:1.0:1782756148.923773:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7 00000100:00100000:1.0:1782756148.923783:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4b606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2354:x1869355209984512:12345-192.168.204.25@tcp:8: 00010000:00080000:1.0:1782756148.923950:0:6602:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 26487635-60cb-4aee-af8e-396654f6c3d8@192.168.204.25@tcp t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:1.0:1782756148.923986:0:6602:0:(genops.c:1406:class_connect()) connect: client 26487635-60cb-4aee-af8e-396654f6c3d8, cookie 0x5e4fb0a8aa198bb3 00002000:00100000:1.0:1782756148.924001:0:6602:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 26487635-60cb-4aee-af8e-396654f6c3d8/ffff9d3b41d9a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782756148.924031:0:6602:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1782756148.925239:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756148.925579:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209984768 00000100:00100000:0.0:1782756148.925589:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209984768 00000100:00100000:0.0:1782756148.925688:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 123 00000100:00100000:0.0:1782756148.925699:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:2356:x1869355209984768:12345-192.168.204.25@tcp:400: 00000100:00100000:0.0:1782756148.925795:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:2356:x1869355209984768:12345-192.168.204.25@tcp:400: Request processed in 98us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756148.925804:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 123 00002000:00080000:1.0:1782756148.926265:0:6602:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782756148.926298:0:6602:0:(import.c:65:import_set_state_nolock()) ffff9d3b41d9f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782756148.926349:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4b606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+6:2354:x1869355209984512:12345-192.168.204.25@tcp:8: Request processed in 2565us (3052us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756148.926357:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7 00000100:00100000:2.0:1782756148.929310:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756148.929357:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756148.929561:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209984640 00000100:00100000:1.0:1782756148.929571:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209984640 00000100:00100000:1.0:1782756148.929627:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8 00000100:00100000:1.0:1782756148.929636:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4b606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1869355209984640:12345-192.168.204.25@tcp:8: 00010000:00080000:1.0:1782756148.929683:0:6603:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 26487635-60cb-4aee-af8e-396654f6c3d8@192.168.204.25@tcp t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:1.0:1782756148.929718:0:6603:0:(genops.c:1406:class_connect()) connect: client 26487635-60cb-4aee-af8e-396654f6c3d8, cookie 0x5e4fb0a8aa198bba 00002000:00100000:1.0:1782756148.929732:0:6603:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 26487635-60cb-4aee-af8e-396654f6c3d8/ffff9d3b41d9b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782756148.929762:0:6603:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782756148.930202:0:6603:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782756148.930234:0:6603:0:(import.c:65:import_set_state_nolock()) ffff9d3b41d9f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782756148.930301:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4b606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+6:2354:x1869355209984640:12345-192.168.204.25@tcp:8: Request processed in 665us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756148.930310:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8 00000100:00100000:3.0:1782756148.932688:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209984896 00000100:00100000:3.0:1782756148.932705:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209984896 00000100:00100000:3.0:1782756148.932776:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 0 00000100:00100000:3.0:1782756148.932787:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4b607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+6:5566:x1869355209984896:12345-192.168.204.25@tcp:33: 00000004:00080000:3.0:1782756148.947584:0:5806:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 14603us 00000004:00200000:1.0:1782756148.958066:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1782756148.958979:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4b607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+6:5566:x1869355209984896:12345-192.168.204.25@tcp:33: Request processed in 26189us (29615us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756148.958993:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 0 00000100:00100000:1.0:1782756149.115748:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756149.115865:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209985024 00000100:00100000:2.0:1782756149.115879:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209985024 00000100:00100000:2.0:1782756149.115949:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8 00000100:00100000:2.0:1782756149.115960:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+6:5604:x1869355209985024:12345-192.168.204.25@tcp:101: 00010000:00010000:2.0:1782756149.115982:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756149.116010:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa198bc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cddc9 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756149.116122:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa198bc8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756149.116385:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa198bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756149.116404:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa198bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756149.116649:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1782756149.116654:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782756149.116738:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa198bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756149.116769:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa198bc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cddc9 expref: 8 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756149.116804:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa198bc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cddc9 expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756149.116812:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c58212300) 00010000:00010000:2.0:1782756149.116815:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782756149.116819:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63d600, rc 0) 00000100:00100000:2.0:1782756149.116895:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+7:5604:x1869355209985024:12345-192.168.204.25@tcp:101: Request processed in 935us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756149.116904:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8 00000100:00100000:1.0:1782756149.198269:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222586880:0@lo:13: 00000100:00100000:1.0:1782756149.198337:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756149.198478:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222586880 00000100:00100000:3.0:1782756149.198496:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222586880 00000100:00100000:3.0:1782756149.198561:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782756149.198570:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222586880:12345-0@lo:13: 00002000:00000024:3.0:1782756149.198592:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782756149.198633:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222586880:12345-0@lo:13: Request processed in 64us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756149.198640:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1782756149.198675:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c78a32a00 x1869355222586880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756165 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756149.198692:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222586880:0@lo:13: 00000100:00080000:1.0:1782756149.198760:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782756149.713859:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782756150.257858:0:6627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 26487635-60cb-4aee-af8e-396654f6c3d8 00000100:00100000:0.0:1782756150.732516:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222587264:0@lo:400: 00000100:00100000:1.0:1782756150.732522:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b604000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869355222587136:0@lo:400: 00000100:00100000:3.0:1782756150.732624:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222587008:0@lo:400: 00000100:00100000:2.0:1782756150.732738:0:7952:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c50167480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7952:1869355222587904:0@lo:700: 00000100:00100000:0.0:1782756150.734540:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756150.734641:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222587776:0@lo:13: 00000100:00100000:0.0:1782756150.734688:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756150.734713:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782756150.734720:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222587392:0@lo:400: 00000100:00100000:0.0:1782756150.734746:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756150.734811:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222587392 00000100:00100000:0.0:1782756150.734819:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222587392 00000100:00100000:0.0:1782756150.734871:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782756150.734880:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c809f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222587392:12345-0@lo:400: 00000100:00100000:0.0:1782756150.734939:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c809f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222587392:12345-0@lo:400: Request processed in 60us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756150.734948:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1782756150.734989:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c4b607800 x1869355222587392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756150.735018:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222587392:0@lo:400: 00000100:00100000:0.0:1782756150.735070:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222587776 00000100:00100000:0.0:1782756150.735093:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222587776 00000100:00100000:0.0:1782756150.735133:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782756150.735140:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c809f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222587776:12345-0@lo:13: 00002000:00000024:0.0:1782756150.735158:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44367872 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782756150.735194:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c809f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222587776:12345-0@lo:13: Request processed in 55us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756150.735201:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1782756150.735229:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c4b605c00 x1869355222587776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756150.735237:0:3314:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1782756150.735254:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222587776:0@lo:13: 00000100:00080000:0.0:1782756150.735288:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782756150.735312:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222587264 00000100:00100000:0.0:1782756150.735316:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222587264 00000100:00100000:0.0:1782756150.735348:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782756150.735356:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c809f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222587264:12345-0@lo:400: 00000100:00100000:0.0:1782756150.735392:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c809f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222587264:12345-0@lo:400: Request processed in 37us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756150.735399:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1782756150.735412:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782756150.735431:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222587264:0@lo:400: 00000100:00100000:1.0:1782756150.735945:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756150.735995:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222587648:0@lo:400: 00000100:00100000:1.0:1782756150.736022:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756150.736060:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222587648 00000100:00100000:0.0:1782756150.736063:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222587136 00000100:00100000:1.0:1782756150.736065:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222587648 00000100:00100000:0.0:1782756150.736070:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222587136 00000100:00100000:1.0:1782756150.736126:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782756150.736138:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782756150.736144:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222587648:12345-0@lo:400: 00000100:00100000:0.0:1782756150.736151:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869355222587136:12345-0@lo:400: 00000100:00100000:1.0:1782756150.736195:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222587648:12345-0@lo:400: Request processed in 53us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756150.736202:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869355222587136:12345-0@lo:400: Request processed in 55us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756150.736209:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782756150.736216:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782756150.736390:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b604000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869355222587136:0@lo:400: 00010000:00080000:0.0:1782756150.736402:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c4b605f80 x1869355222587648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756150.736411:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222587648:0@lo:400: 00000100:00100000:3.0:1782756150.738149:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756150.738194:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869355222587520:0@lo:400: 00000100:00100000:3.0:1782756150.738351:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756150.738400:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222587008 00000100:00100000:0.0:1782756150.738408:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222587008 00000100:00100000:0.0:1782756150.738466:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1782756150.738475:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3316:x1869355222587008:12345-0@lo:400: 00000100:00100000:0.0:1782756150.738555:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3316:x1869355222587008:12345-0@lo:400: Request processed in 80us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756150.738566:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1782756150.738568:0:7952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756150.738604:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222587904 00000100:00100000:2.0:1782756150.738608:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222587904 00000100:00100000:2.0:1782756150.738649:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782756150.738657:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c50167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7952:x1869355222587904:12345-0@lo:700: 00000100:00100000:2.0:1782756150.738700:0:6611:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c50167800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6611:1869355222588032:0@lo:700: 00000100:00100000:2.0:1782756150.738733:0:6611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756150.738752:0:6611:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76c120c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782756150.738766:0:7952:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76c12b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782756150.738770:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222588032 00000100:00100000:0.0:1782756150.738776:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222588032 00000100:00100000:0.0:1782756150.738831:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782756150.738838:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c50165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6611:x1869355222588032:12345-0@lo:700: 00010000:00010000:1.0:1782756150.738971:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756150.738984:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222587520 00000100:00100000:1.0:1782756150.738988:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222587520 00000100:00100000:1.0:1782756150.739019:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782756150.739026:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3316:x1869355222587520:12345-0@lo:400: 00000100:00100000:1.0:1782756150.739067:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3316:x1869355222587520:12345-0@lo:400: Request processed in 41us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756150.739343:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782756150.739449:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222587008:0@lo:400: 00000100:00100000:3.0:1782756150.739464:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869355222587520:0@lo:400: 00000100:00080000:2.0:1782756150.739929:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1782756150.772630:0:5825:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 26487635-60cb-4aee-af8e-396654f6c3d8 40000000:02000000:3.0:1782756150.773571:0:5810:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1782756150.783051:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c50165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6611:x1869355222588032:12345-0@lo:700: Request processed in 44194us (44299us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756150.783067:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782756150.783820:0:6611:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c50167800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6611:1869355222588032:0@lo:700: 40000000:02000000:0.0:1782756150.783836:0:6611:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:3.0:1782756150.827111:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 26487635-60cb-4aee-af8e-396654f6c3d8 00000100:00100000:2.0:1782756150.827291:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c50167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7952:x1869355222587904:12345-0@lo:700: Request processed in 88629us (88720us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756150.827306:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782756150.827442:0:7952:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c50167480 x1869355222587904/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782756166 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756150.827458:0:7952:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c50167480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7952:1869355222587904:0@lo:700: 00000004:02000040:2.0:1782756150.866546:0:7952:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1782756150.871952:0:7952:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c50165c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7952:1869355222588160:0@lo:5: 00000100:00100000:2.0:1782756150.872021:0:7952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756150.872211:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222588160 00000100:00100000:0.0:1782756150.872219:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222588160 00000100:00100000:0.0:1782756150.872324:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782756150.872334:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c50166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7952:x1869355222588160:12345-0@lo:5: 00000100:00100000:2.0:1782756150.873245:0:7952:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76c120c0 going to sleep for 11 seconds 00002000:00080000:1.0:1782756150.877006:0:6603:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1782756150.877030:0:6603:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1782756150.879750:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c50166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7952:x1869355222588160:12345-0@lo:5: Request processed in 7411us (7721us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1782756150.879764:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1782756150.879992:0:7952:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c50165c00 x1869355222588160/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782756166 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756150.880010:0:7952:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c50165c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7952:1869355222588160:0@lo:5: 00000004:00080000:3.0:1782756150.880034:0:7952:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1782756150.933388:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756150.933761:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209985152 00000100:00100000:0.0:1782756150.933772:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209985152 00000100:00080000:2.0:1782756150.933841:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782756150.936013:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9 00000100:00100000:1.0:1782756150.936031:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+6:5657:x1869355209985152:12345-192.168.204.25@tcp:41: 00000004:00000024:1.0:1782756150.936130:0:5805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1782756150.936238:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+6:5657:x1869355209985152:12345-192.168.204.25@tcp:41: Request processed in 212us (2859us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756150.936246:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9 00000100:00100000:1.0:1782756150.946522:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756150.946751:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209985280 00000100:00100000:0.0:1782756150.946762:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209985280 00000100:00100000:0.0:1782756150.946847:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7 00000100:00100000:0.0:1782756150.946863:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:26487635-60cb-4aee-af8e-396654f6c3d8+5:5657:x1869355209985280:12345-192.168.204.25@tcp:13: 00002000:00000024:0.0:1782756150.946909:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782756150.946975:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:26487635-60cb-4aee-af8e-396654f6c3d8+5:5657:x1869355209985280:12345-192.168.204.25@tcp:13: Request processed in 118us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756150.946983:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7 00000100:00080000:2.0:1782756150.947061:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782756150.949956:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756150.950063:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209985408 00000100:00100000:1.0:1782756150.950108:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209985408 00000100:00100000:1.0:1782756150.950172:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8 00000100:00100000:0.0:1782756150.950181:0:6606:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1782756150.950183:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:26487635-60cb-4aee-af8e-396654f6c3d8+5:5657:x1869355209985408:12345-192.168.204.25@tcp:13: 00000100:00100000:0.0:1782756150.950193:0:6606:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1782756150.950212:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1782756150.950267:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782756150.950292:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:26487635-60cb-4aee-af8e-396654f6c3d8+5:5657:x1869355209985408:12345-192.168.204.25@tcp:13: Request processed in 110us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756150.950302:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8 00010000:00010000:0.0:1782756151.758664:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756152.780197:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782756152.814994:0:8156:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1782756153.806773:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756154.157345:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756154.159386:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209985536 00000100:00100000:3.0:1782756154.159399:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209985536 00000100:00100000:3.0:1782756154.159487:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 125 00000100:00100000:3.0:1782756154.159498:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:2355:x1869355209985536:12345-192.168.204.25@tcp:400: 00000100:00100000:3.0:1782756154.159581:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:2355:x1869355209985536:12345-192.168.204.25@tcp:400: Request processed in 84us (2258us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756154.159590:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 125 00000100:00100000:2.0:1782756154.159646:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756154.159750:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756154.159801:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756154.159856:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209985664 00000100:00100000:1.0:1782756154.159861:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209985664 00000100:00100000:1.0:1782756154.159910:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17 00000100:00100000:1.0:1782756154.159918:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c50164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+6:2355:x1869355209985664:12345-192.168.204.25@tcp:400: 00000100:00100000:1.0:1782756154.159957:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c50164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+6:2355:x1869355209985664:12345-192.168.204.25@tcp:400: Request processed in 39us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756154.159964:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17 00000100:00080000:2.0:1782756154.160109:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782756154.162484:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209985792 00000100:00100000:3.0:1782756154.162501:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209985792 00000100:00100000:3.0:1782756154.162589:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209985920 00000100:00100000:3.0:1782756154.162593:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209985920 00000100:00100000:3.0:1782756154.162619:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6 00000100:00100000:3.0:1782756154.162630:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c50166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+5:2356:x1869355209985792:12345-192.168.204.25@tcp:400: 00000100:00080000:2.0:1782756154.162684:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782756154.162689:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782756154.162724:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c50166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+5:2356:x1869355209985792:12345-192.168.204.25@tcp:400: Request processed in 96us (2973us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756154.162731:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6 00000100:00100000:3.0:1782756154.162747:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7 00000100:00100000:3.0:1782756154.162754:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c50165180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+5:2355:x1869355209985920:12345-192.168.204.25@tcp:400: 00000100:00100000:3.0:1782756154.162778:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c50165180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+5:2355:x1869355209985920:12345-192.168.204.25@tcp:400: Request processed in 25us (2977us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756154.162785:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7 00000100:00100000:2.0:1782756154.316739:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782756154.316776:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222588288:0@lo:13: 00000100:00100000:2.0:1782756154.316865:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756154.317261:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222588288 00000100:00100000:0.0:1782756154.317271:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222588288 00000100:00100000:0.0:1782756154.317400:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782756154.317422:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c50166d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222588288:12345-0@lo:13: 00002000:00000024:0.0:1782756154.317635:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782756154.317739:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c50166d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222588288:12345-0@lo:13: Request processed in 329us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756154.317747:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1782756154.317819:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c78ef1c00 x1869355222588288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756170 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756154.317847:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222588288:0@lo:13: 00000100:00080000:2.0:1782756154.318154:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782756154.829014:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782756155.642970:0:8304:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd60a1b00 20000000:00000080:0.0:1782756155.642987:0:8304:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d3c7fa0e000 uarg=0000000000000000 20000000:01000000:0.0:1782756155.643020:0:8304:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1782756155.643022:0:8304:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1782756155.643024:0:8304:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1782756155.643035:0:8304:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1782756155.643040:0:8304:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1782756155.643054:0:8304:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1782756155.643057:0:8304:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1782756155.643615:0:8304:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1782756155.643618:0:8304:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1782756155.644778:0:8305:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1782756155.645469:0:8304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1782756155.645523:0:8304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1782756155.645578:0:8304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1782756155.645590:0:8304:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1782756155.645592:0:8304:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1782756155.646435:0:8306:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1782756155.646789:0:8304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1782756155.646847:0:8304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1782756155.646881:0:8304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1782756155.646892:0:8304:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1782756155.646894:0:8304:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1782756155.648694:0:8307:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1782756155.649523:0:8304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1782756155.649576:0:8304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1782756155.649612:0:8304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1782756155.649627:0:8304:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1782756155.649630:0:8304:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1782756155.650465:0:8308:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1782756155.650837:0:8304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1782756155.650898:0:8304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1782756155.650937:0:8304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:0.0:1782756155.650952:0:8304:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1782756155.650972:0:8304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d3c4b81b800/0x5e4fb0a8aa198bcf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756155.650992:0:8304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c41497000/0x5e4fb0a8aa198acc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198ac5 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756155.651000:0:8304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c40031c00/0x5e4fb0a8aa198af6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198aef expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756155.651021:0:8304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c4168d000/0x5e4fb0a8aa198b20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198b19 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756155.651029:0:8304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c41497c00/0x5e4fb0a8aa198b2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198b27 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756155.651036:0:8304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c41530200/0x5e4fb0a8aa198b3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198b35 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756155.651042:0:8304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa198b58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198b51 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756155.651049:0:8304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c41531800/0x5e4fb0a8aa198b82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198b7b expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756155.651058:0:8304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c4b81bc00/0x5e4fb0a8aa198b90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdd67 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756155.651065:0:8304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c4a63ce00/0x5e4fb0a8aa198b97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdd6e expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756155.651298:0:8304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d3c4b81b800/0x5e4fb0a8aa198bcf lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756155.651343:0:8304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c4a63ce00/0x5e4fb0a8aa198b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdd6e expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756155.651357:0:8304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3c4a63ce00/0x5e4fb0a8aa198b97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdd6e expref: 9 pid: 5797 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756155.651394:0:8304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1869355222588416:192.168.204.25@tcp:104: 00010000:00010000:0.0:1782756155.651532:0:8304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c4b81bc00/0x5e4fb0a8aa198b90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdd67 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756155.651540:0:8304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3c4b81bc00/0x5e4fb0a8aa198b90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdd67 expref: 9 pid: 5796 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756155.651548:0:8304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1869355222588544:192.168.204.25@tcp:104: 00010000:00010000:0.0:1782756155.651576:0:8304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c41531800/0x5e4fb0a8aa198b82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa198b7b expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756155.651584:0:8304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d3c41531800/0x5e4fb0a8aa198b82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198b7b expref: 18 pid: 5798 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756155.651593:0:8304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1869355222588672:0@lo:104: 00000100:00100000:0.0:1782756155.651629:0:8304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782756155.651667:0:8304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa198b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa198b51 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756155.651675:0:8304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa198b58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198b51 expref: 18 pid: 5796 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756155.651683:0:8304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1869355222588800:0@lo:104: 00000100:00100000:0.0:1782756155.651705:0:8304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782756155.651734:0:8304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c41530200/0x5e4fb0a8aa198b3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa198b35 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756155.651742:0:8304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d3c41530200/0x5e4fb0a8aa198b3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198b35 expref: 18 pid: 5797 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756155.651759:0:8304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1869355222588928:0@lo:104: 00010000:00010000:0.0:1782756155.651786:0:8304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c41497c00/0x5e4fb0a8aa198b2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa198b27 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756155.651793:0:8304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d3c41497c00/0x5e4fb0a8aa198b2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198b27 expref: 18 pid: 5798 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756155.651801:0:8304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1869355222589056:0@lo:104: 00010000:00010000:0.0:1782756155.651823:0:8304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c4168d000/0x5e4fb0a8aa198b20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa198b19 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756155.651830:0:8304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d3c4168d000/0x5e4fb0a8aa198b20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198b19 expref: 18 pid: 5796 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756155.651837:0:8304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1869355222589184:0@lo:104: 00010000:00010000:0.0:1782756155.651876:0:8304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c40031c00/0x5e4fb0a8aa198af6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa198aef expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756155.651884:0:8304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d3c40031c00/0x5e4fb0a8aa198af6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198aef expref: 18 pid: 5798 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756155.651892:0:8304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1869355222589312:0@lo:104: 00010000:00010000:0.0:1782756155.651913:0:8304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c41497000/0x5e4fb0a8aa198acc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa198ac5 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756155.651920:0:8304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d3c41497000/0x5e4fb0a8aa198acc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198ac5 expref: 18 pid: 5797 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756155.651940:0:8304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1869355222589440:0@lo:104: 00000100:00100000:0.0:1782756155.651960:0:8304:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4b962f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782756155.652051:0:5787:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782756155.652070:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756155.652104:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756155.652112:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756155.652134:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756155.652142:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756155.652149:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222588672 00000100:00100000:1.0:1782756155.652154:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222588672 00000100:00100000:1.0:1782756155.652194:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222588800 00000100:00100000:1.0:1782756155.652197:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222588800 00000100:00100000:1.0:1782756155.652216:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222588928 00000100:00100000:1.0:1782756155.652219:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222588928 00000100:00100000:1.0:1782756155.652225:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222589056 00000100:00100000:1.0:1782756155.652227:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222589056 00000100:00100000:1.0:1782756155.652234:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222589184 00000100:00100000:1.0:1782756155.652236:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222589184 00000100:00100000:1.0:1782756155.652244:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222589312 00000100:00100000:1.0:1782756155.652246:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222589312 00000100:00100000:1.0:1782756155.652253:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222589440 00000100:00100000:1.0:1782756155.652255:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222589440 00000100:00100000:1.0:1782756155.652266:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782756155.652273:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c809f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+9:8304:x1869355222588672:12345-0@lo:104: 00010000:00010000:1.0:1782756155.652285:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d200/0x5e4fb0a8aa198b7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198b82 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.652341:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782756155.652347:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c809f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+9:8304:x1869355222588672:12345-0@lo:104: Request processed in 75us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756155.652355:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782756155.652372:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782756155.652379:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+8:8304:x1869355222588800:12345-0@lo:104: 00010000:00010000:1.0:1782756155.652395:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198b58 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.652431:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782756155.652436:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+8:8304:x1869355222588800:12345-0@lo:104: Request processed in 58us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756155.652441:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782756155.652471:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782756155.652478:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fcc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+7:8304:x1869355222588928:12345-0@lo:104: 00010000:00010000:1.0:1782756155.652492:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: ffff9d3c40030200/0x5e4fb0a8aa198b35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198b3c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.652518:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1782756155.652523:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fcc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+7:8304:x1869355222588928:12345-0@lo:104: Request processed in 46us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756155.652529:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782756155.652541:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782756155.652546:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+6:8304:x1869355222589056:12345-0@lo:104: 00010000:00010000:1.0:1782756155.652553:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: ffff9d3c41530800/0x5e4fb0a8aa198b27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198b2e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.652575:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1782756155.652580:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+6:8304:x1869355222589056:12345-0@lo:104: Request processed in 35us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756155.652586:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782756155.652596:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782756155.652601:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+5:8304:x1869355222589184:12345-0@lo:104: 00010000:00010000:1.0:1782756155.652607:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: ffff9d3c40030000/0x5e4fb0a8aa198b19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198b20 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.652631:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1782756155.652635:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+5:8304:x1869355222589184:12345-0@lo:104: Request processed in 35us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756155.652640:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782756155.652649:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782756155.652655:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+4:8304:x1869355222589312:12345-0@lo:104: 00010000:00010000:1.0:1782756155.652667:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198aef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198af6 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.652694:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1782756155.652698:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+4:8304:x1869355222589312:12345-0@lo:104: Request processed in 44us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756155.652704:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782756155.652716:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782756155.652721:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+3:8304:x1869355222589440:12345-0@lo:104: 00010000:00010000:1.0:1782756155.652727:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: ffff9d3c4168cc00/0x5e4fb0a8aa198ac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198acc expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.652752:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1782756155.652757:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+3:8304:x1869355222589440:12345-0@lo:104: Request processed in 36us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756155.652762:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1782756155.652778:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1782756155.652783:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d200/0x5e4fb0a8aa198b7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198b82 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.652789:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168d200 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:1.0:1782756155.652793:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d200/0x5e4fb0a8aa198b7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa198b82 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.652802:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d200/0x5e4fb0a8aa198b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa198b82 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782756155.652809:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d200/0x5e4fb0a8aa198b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa198b82 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756155.652823:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782756155.652853:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d200/0x5e4fb0a8aa198b7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198b82 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.652860:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782756155.652878:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d200/0x5e4fb0a8aa198b7b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198b82 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.652885:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d200/0x5e4fb0a8aa198b7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198b82 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.652898:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1782756155.652901:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198b58 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.652907:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41530600 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:1.0:1782756155.652910:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa198b58 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.652915:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa198b58 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782756155.652921:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa198b58 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756155.652926:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782756155.652937:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198b51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198b58 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.652943:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782756155.652955:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198b51 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198b58 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.652961:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198b51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198b58 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.652971:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1782756155.652975:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c40030200/0x5e4fb0a8aa198b35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198b3c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.652980:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c40030200 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:1.0:1782756155.652983:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c40030200/0x5e4fb0a8aa198b35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa198b3c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.652989:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c40030200/0x5e4fb0a8aa198b35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa198b3c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782756155.652995:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c40030200/0x5e4fb0a8aa198b35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa198b3c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756155.653000:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782756155.653013:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c40030200/0x5e4fb0a8aa198b35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198b3c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.653018:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782756155.653033:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c40030200/0x5e4fb0a8aa198b35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198b3c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.653040:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c40030200/0x5e4fb0a8aa198b35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198b3c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.653049:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1782756155.653057:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c41530800/0x5e4fb0a8aa198b27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198b2e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.653063:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41530800 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:1.0:1782756155.653066:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41530800/0x5e4fb0a8aa198b27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa198b2e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.653099:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c41530800/0x5e4fb0a8aa198b27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa198b2e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782756155.653106:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41530800/0x5e4fb0a8aa198b27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa198b2e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756155.653111:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782756155.653124:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c41530800/0x5e4fb0a8aa198b27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198b2e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.653129:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782756155.653134:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c41530800/0x5e4fb0a8aa198b27 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198b2e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.653141:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c41530800/0x5e4fb0a8aa198b27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198b2e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.653149:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782756155.653152:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c40030000/0x5e4fb0a8aa198b19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198b20 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.653156:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c40030000 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:1.0:1782756155.653159:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c40030000/0x5e4fb0a8aa198b19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa198b20 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.653174:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c40030000/0x5e4fb0a8aa198b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa198b20 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782756155.653180:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c40030000/0x5e4fb0a8aa198b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa198b20 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756155.653185:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782756155.653196:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c40030000/0x5e4fb0a8aa198b19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198b20 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.653202:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782756155.653205:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c40030000/0x5e4fb0a8aa198b19 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198b20 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.653212:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c40030000/0x5e4fb0a8aa198b19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198b20 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.653220:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782756155.653222:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198aef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198af6 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.653227:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41530c00 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:1.0:1782756155.653229:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198aef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa198af6 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.653235:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198aef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa198af6 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782756155.653241:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198aef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa198af6 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756155.653250:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782756155.653262:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198aef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198af6 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.653267:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782756155.653271:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198aef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198af6 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.653277:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198aef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198af6 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.653285:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782756155.653287:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c4168cc00/0x5e4fb0a8aa198ac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198acc expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.653292:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168cc00 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:1.0:1782756155.653295:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4168cc00/0x5e4fb0a8aa198ac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa198acc expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.653302:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c4168cc00/0x5e4fb0a8aa198ac5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa198acc expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782756155.653307:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4168cc00/0x5e4fb0a8aa198ac5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa198acc expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756155.653312:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782756155.653322:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c4168cc00/0x5e4fb0a8aa198ac5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198acc expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.653328:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782756155.653338:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c4168cc00/0x5e4fb0a8aa198ac5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198acc expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.653344:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c4168cc00/0x5e4fb0a8aa198ac5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198acc expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.653357:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756155.653359:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756155.653361:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756155.653368:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756155.653398:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222589568:0@lo:103: 00000100:00100000:1.0:1782756155.653432:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756155.653452:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222590080:0@lo:103: 00000100:00100000:1.0:1782756155.653467:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756155.653483:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782756155.653488:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222589696:0@lo:103: 00000100:00100000:1.0:1782756155.653506:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756155.653518:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222590208:0@lo:103: 00000100:00100000:1.0:1782756155.653546:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756155.653567:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0daec403-69b6-4c98-a0ea-f519ca0a480f:3314:1869355222589824:0@lo:103: 00000100:00100000:1.0:1782756155.653585:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756155.653593:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0daec403-69b6-4c98-a0ea-f519ca0a480f:3314:1869355222590336:0@lo:103: 00000100:00100000:1.0:1782756155.653608:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756155.653617:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782756155.653621:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0daec403-69b6-4c98-a0ea-f519ca0a480f:3314:1869355222589952:0@lo:103: 00000100:00100000:1.0:1782756155.653640:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756155.653662:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222589568 00000100:00100000:1.0:1782756155.653673:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222589568 00010000:00010000:1.0:1782756155.653693:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c41531800/0x5e4fb0a8aa198b82 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198b7b expref: 19 pid: 5798 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756155.653709:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222590080 00000100:00100000:1.0:1782756155.653712:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222590080 00010000:00010000:1.0:1782756155.653722:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c4168d000/0x5e4fb0a8aa198b20 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198b19 expref: 20 pid: 5796 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756155.653732:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222589696 00000100:00100000:1.0:1782756155.653735:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222589696 00010000:00010000:1.0:1782756155.653746:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa198b58 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198b51 expref: 21 pid: 5796 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756155.653756:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222590208 00000100:00100000:1.0:1782756155.653758:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222590208 00010000:00010000:1.0:1782756155.653766:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c40031c00/0x5e4fb0a8aa198af6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198aef expref: 22 pid: 5798 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756155.653775:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222589824 00000100:00100000:1.0:1782756155.653777:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222589824 00010000:00010000:1.0:1782756155.653784:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c41530200/0x5e4fb0a8aa198b3c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198b35 expref: 23 pid: 5797 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756155.653793:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222590336 00000100:00100000:1.0:1782756155.653796:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222590336 00010000:00010000:1.0:1782756155.653804:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c41497000/0x5e4fb0a8aa198acc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198ac5 expref: 24 pid: 5797 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756155.653814:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222589952 00000100:00100000:1.0:1782756155.653816:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222589952 00010000:00010000:1.0:1782756155.653825:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c41497c00/0x5e4fb0a8aa198b2e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198b27 expref: 25 pid: 5798 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756155.653851:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782756155.653858:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0daec403-69b6-4c98-a0ea-f519ca0a480f+25:3316:x1869355222589568:12345-0@lo:103: 00010000:00010000:1.0:1782756155.653869:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756155.653874:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c41531800/0x5e4fb0a8aa198b82 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198b7b expref: 25 pid: 5798 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.653883:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c41531800/0x5e4fb0a8aa198b82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198b7b expref: 25 pid: 5798 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.653901:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782756155.653932:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0daec403-69b6-4c98-a0ea-f519ca0a480f+25:3316:x1869355222589568:12345-0@lo:103: Request processed in 75us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756155.653939:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782756155.653953:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782756155.653960:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0daec403-69b6-4c98-a0ea-f519ca0a480f+24:3316:x1869355222590080:12345-0@lo:103: 00010000:00010000:1.0:1782756155.653967:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756155.653971:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c4168d000/0x5e4fb0a8aa198b20 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198b19 expref: 24 pid: 5796 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.653979:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c4168d000/0x5e4fb0a8aa198b20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198b19 expref: 24 pid: 5796 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.653989:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782756155.654009:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0daec403-69b6-4c98-a0ea-f519ca0a480f+24:3316:x1869355222590080:12345-0@lo:103: Request processed in 50us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756155.654014:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782756155.654026:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782756155.654039:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78a31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0daec403-69b6-4c98-a0ea-f519ca0a480f+23:3316:x1869355222589696:12345-0@lo:103: 00010000:00010000:1.0:1782756155.654046:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756155.654051:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa198b58 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198b51 expref: 23 pid: 5796 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.654059:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa198b58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198b51 expref: 23 pid: 5796 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.654068:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782756155.654111:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78a31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0daec403-69b6-4c98-a0ea-f519ca0a480f+23:3316:x1869355222589696:12345-0@lo:103: Request processed in 72us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756155.654117:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782756155.654130:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782756155.654135:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0daec403-69b6-4c98-a0ea-f519ca0a480f+22:3316:x1869355222590208:12345-0@lo:103: 00010000:00010000:1.0:1782756155.654142:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756155.654145:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c40031c00/0x5e4fb0a8aa198af6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198aef expref: 22 pid: 5798 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.654152:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c40031c00/0x5e4fb0a8aa198af6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198aef expref: 22 pid: 5798 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.654160:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782756155.654179:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0daec403-69b6-4c98-a0ea-f519ca0a480f+22:3316:x1869355222590208:12345-0@lo:103: Request processed in 44us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756155.654185:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782756155.654196:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782756155.654201:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0daec403-69b6-4c98-a0ea-f519ca0a480f+21:3314:x1869355222589824:12345-0@lo:103: 00010000:00010000:1.0:1782756155.654208:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756155.654218:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c41530200/0x5e4fb0a8aa198b3c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198b35 expref: 21 pid: 5797 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.654227:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c41530200/0x5e4fb0a8aa198b3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198b35 expref: 21 pid: 5797 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.654235:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782756155.654262:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0daec403-69b6-4c98-a0ea-f519ca0a480f+21:3314:x1869355222589824:12345-0@lo:103: Request processed in 60us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756155.654268:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782756155.654280:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782756155.654286:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0daec403-69b6-4c98-a0ea-f519ca0a480f+20:3314:x1869355222590336:12345-0@lo:103: 00010000:00010000:1.0:1782756155.654292:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756155.654296:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c41497000/0x5e4fb0a8aa198acc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198ac5 expref: 20 pid: 5797 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.654304:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c41497000/0x5e4fb0a8aa198acc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198ac5 expref: 20 pid: 5797 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.654312:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782756155.654331:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0daec403-69b6-4c98-a0ea-f519ca0a480f+20:3314:x1869355222590336:12345-0@lo:103: Request processed in 46us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756155.654336:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782756155.654347:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782756155.654352:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aa1a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3314:x1869355222589952:12345-0@lo:103: 00010000:00010000:1.0:1782756155.654359:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756155.654363:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c41497c00/0x5e4fb0a8aa198b2e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198b27 expref: 19 pid: 5798 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.654381:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c41497c00/0x5e4fb0a8aa198b2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198b27 expref: 19 pid: 5798 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.654402:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782756155.654423:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aa1a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3314:x1869355222589952:12345-0@lo:103: Request processed in 71us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756155.654428:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782756155.654487:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0daec403-69b6-4c98-a0ea-f519ca0a480f:3314:1869355222589952:0@lo:103: 00000100:00100000:1.0:1782756155.654496:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0daec403-69b6-4c98-a0ea-f519ca0a480f:3314:1869355222589824:0@lo:103: 00000100:00100000:1.0:1782756155.654502:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0daec403-69b6-4c98-a0ea-f519ca0a480f:3314:1869355222590336:0@lo:103: 00000100:00100000:1.0:1782756155.654525:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222589696:0@lo:103: 00000100:00100000:1.0:1782756155.654531:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222590208:0@lo:103: 00000100:00100000:1.0:1782756155.654537:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222589568:0@lo:103: 00000100:00100000:1.0:1782756155.654543:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222590080:0@lo:103: 00010000:00010000:0.0:1782756155.654741:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c41531800/0x5e4fb0a8aa198b82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa198b7b expref: 18 pid: 5798 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756155.654753:0:8304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1869355222588672:0@lo:104: 00010000:00010000:0.0:1782756155.654763:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa198b58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa198b51 expref: 17 pid: 5796 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756155.654771:0:8304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1869355222588800:0@lo:104: 00010000:00010000:0.0:1782756155.654780:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c41530200/0x5e4fb0a8aa198b3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa198b35 expref: 16 pid: 5797 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756155.654787:0:8304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1869355222588928:0@lo:104: 00010000:00010000:0.0:1782756155.654795:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c41497c00/0x5e4fb0a8aa198b2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa198b27 expref: 15 pid: 5798 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756155.654803:0:8304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1869355222589056:0@lo:104: 00010000:00010000:0.0:1782756155.654812:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4168d000/0x5e4fb0a8aa198b20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa198b19 expref: 14 pid: 5796 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756155.654820:0:8304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1869355222589184:0@lo:104: 00010000:00010000:0.0:1782756155.654828:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c40031c00/0x5e4fb0a8aa198af6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa198aef expref: 13 pid: 5798 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756155.654837:0:8304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1869355222589312:0@lo:104: 00010000:00010000:0.0:1782756155.654847:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c41497000/0x5e4fb0a8aa198acc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa198ac5 expref: 12 pid: 5797 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756155.654863:0:8304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1869355222589440:0@lo:104: 00000100:00100000:3.0:1782756155.659778:0:8304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1869355222588416:192.168.204.25@tcp:104: 00000100:00100000:3.0:1782756155.661478:0:8304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1869355222588544:192.168.204.25@tcp:104: 00010000:00010000:3.0:1782756155.661536:0:8304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d3c4b81b800/0x5e4fb0a8aa198bcf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756155.662742:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756155.662782:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756155.662871:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209986176 00000100:00100000:1.0:1782756155.662881:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209986176 00010000:00010000:1.0:1782756155.662925:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c4b81bc00/0x5e4fb0a8aa198b90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdd67 expref: 10 pid: 5796 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756155.662962:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209986048 00000100:00100000:1.0:1782756155.662965:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209986048 00010000:00010000:1.0:1782756155.662978:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c4a63ce00/0x5e4fb0a8aa198b97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdd6e expref: 11 pid: 5797 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756155.662993:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19 00000100:00100000:1.0:1782756155.663014:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+11:2356:x1869355209986176:12345-192.168.204.25@tcp:103: 00010000:00010000:1.0:1782756155.663029:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756155.663035:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c4b81bc00/0x5e4fb0a8aa198b90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdd67 expref: 11 pid: 5796 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.663047:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c4b81bc00/0x5e4fb0a8aa198b90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdd67 expref: 11 pid: 5796 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.663065:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4b81bc00/0x5e4fb0a8aa198b90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdd67 expref: 11 pid: 5796 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.663112:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782756155.663172:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:2356:x1869355209986176:12345-192.168.204.25@tcp:103: Request processed in 158us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756155.663181:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19 00000100:00100000:1.0:1782756155.663200:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20 00000100:00100000:1.0:1782756155.663206:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+9:2355:x1869355209986048:12345-192.168.204.25@tcp:103: 00010000:00010000:1.0:1782756155.663214:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756155.663219:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c4a63ce00/0x5e4fb0a8aa198b97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdd6e expref: 9 pid: 5797 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.663230:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c4a63ce00/0x5e4fb0a8aa198b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdd6e expref: 9 pid: 5797 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.663240:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4a63ce00/0x5e4fb0a8aa198b97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdd6e expref: 9 pid: 5797 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.663260:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d3c4b81b800/0x5e4fb0a8aa198bcf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.663276:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4b81b800/0x5e4fb0a8aa198bcf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.663291:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3c4b81b800/0x5e4fb0a8aa198bcf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.663298:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3c4b81b800/0x5e4fb0a8aa198bcf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.663304:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d3c4b81b800/0x5e4fb0a8aa198bcf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.663311:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d3c4b81b800/0x5e4fb0a8aa198bcf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.663317:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81b800 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:1.0:1782756155.663321:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d3c4b81b800/0x5e4fb0a8aa198bcf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.663330:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d3c4b81b800/0x5e4fb0a8aa198bcf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.663342:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d3c4b81b800/0x5e4fb0a8aa198bcf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756155.663352:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782756155.663372:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+8:2355:x1869355209986048:12345-192.168.204.25@tcp:103: Request processed in 166us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756155.663379:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20 00010000:00010000:3.0:1782756155.663856:0:8304:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d3c4b81b800/0x5e4fb0a8aa198bcf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756155.663867:0:8304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d3c4b81b800/0x5e4fb0a8aa198bcf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756155.663873:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4b81b800/0x5e4fb0a8aa198bcf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756155.852479:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222590464:0@lo:13: 00000100:00100000:3.0:1782756155.852552:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756155.852750:0:8071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222590464 00000100:00100000:0.0:1782756155.852758:0:8071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222590464 00000100:00100000:1.0:1782756155.852764:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222590592:0@lo:400: 00000100:00080000:2.0:1782756155.852857:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782756155.852882:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756155.852922:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869355222591104:0@lo:400: 00000100:00100000:1.0:1782756155.852957:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756155.852983:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782756155.852991:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869355222590720:0@lo:400: 00000100:00100000:1.0:1782756155.853020:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756155.853065:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222591104 00000100:00100000:1.0:1782756155.853069:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222591104 00000100:00080000:2.0:1782756155.853113:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782756155.853135:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222590720 00000100:00100000:1.0:1782756155.853140:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222590720 00000100:00100000:1.0:1782756155.853162:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782756155.853171:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869355222591104:12345-0@lo:400: 00000100:00100000:1.0:1782756155.853220:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869355222591104:12345-0@lo:400: Request processed in 50us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756155.853227:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782756155.853244:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782756155.853250:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869355222590720:12345-0@lo:400: 00000100:00100000:1.0:1782756155.853276:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869355222590720:12345-0@lo:400: Request processed in 26us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756155.853281:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782756155.856492:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782756155.856514:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1869355222590464:12345-0@lo:13: 00002000:00000024:3.0:1782756155.856555:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782756155.856644:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1869355222590464:12345-0@lo:13: Request processed in 126us (4079us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756155.856652:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782756155.856709:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222590848:0@lo:400: 00000100:00100000:3.0:1782756155.856770:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756155.856802:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782756155.856808:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222590976:0@lo:400: 00000100:00100000:3.0:1782756155.856831:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756155.856856:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222590976 00000100:00100000:3.0:1782756155.856864:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222590976 00000100:00100000:3.0:1782756155.856899:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782756155.856906:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222590976:12345-0@lo:400: 00000100:00100000:3.0:1782756155.856942:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222590976:12345-0@lo:400: Request processed in 37us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756155.856948:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1782756155.856991:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c78ef0e00 x1869355222590464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756155.857011:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222590464:0@lo:13: 00010000:00080000:3.0:1782756155.857041:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c6a33d500 x1869355222590976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756155.857052:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222590976:0@lo:400: 00000100:00100000:3.0:1782756155.857071:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222590848 00000100:00100000:3.0:1782756155.857107:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222590848 00000100:00100000:3.0:1782756155.857146:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782756155.857153:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222590848:12345-0@lo:400: 00000100:00100000:3.0:1782756155.857186:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222590848:12345-0@lo:400: Request processed in 33us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756155.857193:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1782756155.857212:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782756155.857245:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222590848:0@lo:400: 00010000:00010000:3.0:1782756155.857313:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756155.857348:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222590592 00000100:00100000:0.0:1782756155.857352:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222590592 00000100:00100000:0.0:1782756155.857392:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1782756155.857400:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:3316:x1869355222590592:12345-0@lo:400: 00000100:00100000:0.0:1782756155.857571:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:3316:x1869355222590592:12345-0@lo:400: Request processed in 172us (4756us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756155.857578:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1782756155.858250:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869355222590720:0@lo:400: 00000100:00100000:0.0:1782756155.858267:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222590592:0@lo:400: 00000100:00100000:0.0:1782756155.858284:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869355222591104:0@lo:400: 00000001:00080000:0.0:1782756155.926406:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:2.0:1782756156.332274:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756156.332380:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209986304 00000100:00100000:3.0:1782756156.332390:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209986304 00000100:00100000:3.0:1782756156.332451:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 127 00000100:00100000:3.0:1782756156.332462:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+8:5580:x1869355209986304:12345-192.168.204.25@tcp:101: 00010000:00010000:3.0:1782756156.332481:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756156.332614:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c41530e00/0x5e4fb0a8aa198bd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cddd0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756156.332649:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c41530e00/0x5e4fb0a8aa198bd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cddd0 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756156.332661:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c41530e00/0x5e4fb0a8aa198bd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cddd0 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756156.332672:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41530e00, rc 0) 00000100:00100000:3.0:1782756156.334087:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+9:5580:x1869355209986304:12345-192.168.204.25@tcp:101: Request processed in 1606us (1803us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756156.334098:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 127 00000100:00100000:0.0:1782756156.349520:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756156.350893:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209986432 00000100:00100000:2.0:1782756156.350906:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209986432 00000100:00100000:2.0:1782756156.351155:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 128 00000100:00100000:2.0:1782756156.351168:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+9:5580:x1869355209986432:12345-192.168.204.25@tcp:501: 00000100:00100000:2.0:1782756156.351515:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+9:5580:x1869355209986432:12345-192.168.204.25@tcp:501: Request processed in 347us (2152us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756156.351522:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 128 00000100:00100000:1.0:1782756156.355621:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756156.359682:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209986560 00000100:00100000:3.0:1782756156.359702:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209986560 00000100:00100000:3.0:1782756156.359856:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 129 00000100:00100000:3.0:1782756156.359868:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+9:5580:x1869355209986560:12345-192.168.204.25@tcp:503: 00000100:00100000:3.0:1782756156.360224:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+9:5580:x1869355209986560:12345-192.168.204.25@tcp:503: Request processed in 358us (4612us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756156.360242:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 129 00000100:00100000:1.0:1782756156.368904:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756156.369141:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209986688 00000100:00100000:2.0:1782756156.369151:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209986688 00000100:00100000:2.0:1782756156.369209:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 130 00000100:00100000:2.0:1782756156.369219:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+9:6044:x1869355209986688:12345-192.168.204.25@tcp:502: 00000100:00100000:2.0:1782756156.369537:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+9:6044:x1869355209986688:12345-192.168.204.25@tcp:502: Request processed in 319us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756156.369545:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 130 00000100:00100000:1.0:1782756156.373317:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756156.373401:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209986816 00000100:00100000:3.0:1782756156.373421:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209986816 00000100:00100000:3.0:1782756156.373523:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 131 00000100:00100000:3.0:1782756156.373534:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+9:6044:x1869355209986816:12345-192.168.204.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782756156.373813:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+9:6044:x1869355209986816:12345-192.168.204.25@tcp:502:llog_process_th.0 Request processed in 280us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756156.373820:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 131 00000100:00100000:1.0:1782756156.377334:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756156.377434:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209986944 00000100:00100000:0.0:1782756156.377445:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209986944 00000100:00100000:0.0:1782756156.377511:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 132 00000100:00100000:0.0:1782756156.377520:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+9:5580:x1869355209986944:12345-192.168.204.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782756156.377537:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756156.377554:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4b81ac00/0x5e4fb0a8aa198bdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cddd7 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756156.377583:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4b81ac00/0x5e4fb0a8aa198bdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cddd7 expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756156.377613:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4b81ac00/0x5e4fb0a8aa198bdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cddd7 expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756156.377622:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81ac00, rc 0) 00000100:00100000:0.0:1782756156.377815:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:5580:x1869355209986944:12345-192.168.204.25@tcp:101:ll_cfg_requeue.0 Request processed in 295us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756156.377823:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 132 00000100:00100000:1.0:1782756156.381797:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756156.382094:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209987072 00000100:00100000:3.0:1782756156.382104:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209987072 00000100:00100000:3.0:1782756156.382216:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 133 00000100:00100000:3.0:1782756156.382227:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:5580:x1869355209987072:12345-192.168.204.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782756156.382542:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:5580:x1869355209987072:12345-192.168.204.25@tcp:501:ll_cfg_requeue.0 Request processed in 315us (754us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782756156.382550:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 133 10000000:01000000:1.0:1782756156.748187:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782756156.748194:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9d3c80977000 from 39 10000000:01000000:1.0:1782756156.748215:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782756156.748263:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41497800/0x5e4fb0a8aa198be4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756156.748275:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c41497800/0x5e4fb0a8aa198be4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756156.748287:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c41497800/0x5e4fb0a8aa198be4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756156.748310:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222591232:0@lo:101: 00000100:00100000:1.0:1782756156.748495:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756156.748559:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a1436c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782756156.748568:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222591232 00000100:00100000:0.0:1782756156.748575:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222591232 00000100:00100000:0.0:1782756156.748623:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1782756156.748632:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+12:5800:x1869355222591232:12345-0@lo:101: 00010000:00010000:0.0:1782756156.748646:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756156.748659:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4b81b400/0x5e4fb0a8aa198beb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198be4 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756156.748682:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4b81b400/0x5e4fb0a8aa198beb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198be4 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756156.748692:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4b81b400/0x5e4fb0a8aa198beb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198be4 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756156.748701:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81b400, rc 0) 00000100:00100000:0.0:1782756156.748756:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:5800:x1869355222591232:12345-0@lo:101: Request processed in 124us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756156.748763:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1782756156.748904:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222591232:0@lo:101: 00010000:00010000:1.0:1782756156.748919:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c41497800/0x5e4fb0a8aa198be4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198beb expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756156.748928:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c41497800/0x5e4fb0a8aa198be4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198beb expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756156.748978:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222591360:0@lo:501: 00000100:00100000:1.0:1782756156.749002:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756156.749024:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a1436c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782756156.749105:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222591360 00000100:00100000:3.0:1782756156.749110:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222591360 00000100:00100000:3.0:1782756156.749145:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1782756156.749152:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:5800:x1869355222591360:12345-0@lo:501: 00000100:00100000:3.0:1782756156.749424:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:5800:x1869355222591360:12345-0@lo:501: Request processed in 272us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756156.749431:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1782756156.749679:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222591360:0@lo:501: 00000100:00100000:1.0:1782756156.749707:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222591488:0@lo:503: 00000100:00100000:1.0:1782756156.749746:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756156.749774:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a1436c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782756156.749833:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222591488 00000100:00100000:2.0:1782756156.749838:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222591488 00000100:00100000:2.0:1782756156.749870:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1782756156.749877:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:5800:x1869355222591488:12345-0@lo:503: 00000100:00100000:2.0:1782756156.750026:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:5800:x1869355222591488:12345-0@lo:503: Request processed in 149us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756156.750032:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1782756156.750109:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222591488:0@lo:503: 00000100:00100000:0.0:1782756156.752008:0:8322:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8322:1869355222591616:0@lo:502: 00000100:00100000:0.0:1782756156.752115:0:8322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756156.752160:0:8322:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a7a7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782756156.752467:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222591616 00000100:00100000:3.0:1782756156.752475:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222591616 00000100:00100000:3.0:1782756156.752575:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1782756156.752585:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:8322:x1869355222591616:12345-0@lo:502: 00000100:00100000:3.0:1782756156.752857:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:8322:x1869355222591616:12345-0@lo:502: Request processed in 273us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756156.752874:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1782756156.752923:0:8322:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8322:1869355222591616:0@lo:502: 00000100:00100000:1.0:1782756156.752976:0:8322:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8322:1869355222591744:0@lo:502: 00000100:00100000:1.0:1782756156.753021:0:8322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756156.753094:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222591744 00000100:00100000:0.0:1782756156.753099:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222591744 00000100:00100000:0.0:1782756156.753122:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1782756156.753128:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:8322:x1869355222591744:12345-0@lo:502: 00000100:00100000:1.0:1782756156.753178:0:8322:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a1436c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782756156.753483:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:8322:x1869355222591744:12345-0@lo:502: Request processed in 354us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756156.753490:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1782756156.757491:0:8322:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8322:1869355222591744:0@lo:502: 00000040:00080000:1.0:1782756156.757549:0:8322:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1782756156.757818:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1782756156.757843:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782756156.757854:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41497800/0x5e4fb0a8aa198be4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198beb expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756156.757866:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c41497800/0x5e4fb0a8aa198be4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198beb expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782756156.757875:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1782756156.757878:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1782756156.757881:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1782756156.757921:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b200/0x5e4fb0a8aa198bf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756156.757939:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b200/0x5e4fb0a8aa198bf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756156.757949:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b200/0x5e4fb0a8aa198bf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756156.757969:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222591872:0@lo:101: 00000100:00100000:0.0:1782756156.758028:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756156.758115:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a7a7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782756156.758265:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222591872 00000100:00100000:1.0:1782756156.758274:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222591872 00000100:00100000:1.0:1782756156.758324:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1782756156.758333:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+13:5800:x1869355222591872:12345-0@lo:101: 00010000:00010000:1.0:1782756156.758346:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756156.758359:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c41497000/0x5e4fb0a8aa198bf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198bf2 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756156.758393:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c41497000/0x5e4fb0a8aa198bf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198bf2 expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756156.758405:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c41497000/0x5e4fb0a8aa198bf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198bf2 expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756156.758414:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41497000, rc 0) 00000100:00100000:1.0:1782756156.758612:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:5800:x1869355222591872:12345-0@lo:101: Request processed in 129us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756156.758620:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1782756156.758698:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222591872:0@lo:101: 00010000:00010000:0.0:1782756156.758711:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b200/0x5e4fb0a8aa198bf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198bf9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756156.758720:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b200/0x5e4fb0a8aa198bf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198bf9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756156.758769:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222592000:0@lo:501: 00000100:00100000:0.0:1782756156.758795:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756156.758821:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a7a7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782756156.758869:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222592000 00000100:00100000:3.0:1782756156.758875:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222592000 00000100:00100000:3.0:1782756156.758907:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1782756156.758915:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:5800:x1869355222592000:12345-0@lo:501: 00000100:00100000:3.0:1782756156.759222:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:5800:x1869355222592000:12345-0@lo:501: Request processed in 307us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756156.759229:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1782756156.759947:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222592000:0@lo:501: 00000100:00100000:0.0:1782756156.759990:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222592128:0@lo:503: 00000100:00100000:0.0:1782756156.760045:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756156.760100:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a7a7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782756156.760344:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222592128 00000100:00100000:1.0:1782756156.760350:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222592128 00000100:00100000:1.0:1782756156.760391:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1782756156.760407:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:5800:x1869355222592128:12345-0@lo:503: 00000100:00100000:1.0:1782756156.760741:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:5800:x1869355222592128:12345-0@lo:503: Request processed in 335us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756156.760750:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1782756156.761639:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222592128:0@lo:503: 00000100:00100000:0.0:1782756156.762632:0:8323:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8323:1869355222592256:0@lo:502: 00000100:00100000:0.0:1782756156.762710:0:8323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756156.762783:0:8323:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a7a7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782756156.762862:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222592256 00000100:00100000:2.0:1782756156.762869:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222592256 00000100:00100000:1.0:1782756156.762996:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1782756156.763006:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:8323:x1869355222592256:12345-0@lo:502: 00000100:00100000:1.0:1782756156.763341:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:8323:x1869355222592256:12345-0@lo:502: Request processed in 337us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756156.763349:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1782756156.763677:0:8323:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8323:1869355222592256:0@lo:502: 00000020:01000000:0.0:1782756156.763706:0:8323:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782756156.763716:0:8323:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782756156.763719:0:8323:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1782756156.763725:0:8323:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1782756156.763750:0:8323:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8323:1869355222592384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782756156.763787:0:8323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756156.767104:0:8323:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3b4116f300 going to sleep for 11 seconds 00000100:00100000:3.0:1782756156.775650:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222592384 00000100:00100000:3.0:1782756156.775665:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222592384 00000100:00100000:3.0:1782756156.775749:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1782756156.775760:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:8323:x1869355222592384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782756156.776065:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:8323:x1869355222592384:12345-0@lo:502:llog_process_th.0 Request processed in 305us (12276us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756156.776088:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1782756156.778271:0:8323:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8323:1869355222592384:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782756156.778322:0:8323:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782756156.778333:0:8323:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782756156.778336:0:8323:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1782756156.778342:0:8323:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1782756156.778499:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1782756156.778515:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1782756156.778526:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b200/0x5e4fb0a8aa198bf2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198bf9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756156.778538:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b200/0x5e4fb0a8aa198bf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198bf9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782756156.778568:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782756156.778570:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9d3c4a734800 from 39 10000000:01000000:3.0:1782756156.778573:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782756156.778609:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41530200/0x5e4fb0a8aa198c00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756156.778618:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c41530200/0x5e4fb0a8aa198c00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756156.778628:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c41530200/0x5e4fb0a8aa198c00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756156.778650:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222592512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782756156.778710:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756156.778746:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a176180 going to sleep for 11 seconds 00000100:00100000:3.0:1782756156.778765:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222592512 00000100:00100000:3.0:1782756156.778770:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222592512 00000100:00100000:3.0:1782756156.778806:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1782756156.778815:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:5800:x1869355222592512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782756156.778829:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756156.778843:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c41531800/0x5e4fb0a8aa198c07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198c00 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756156.778868:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c41531800/0x5e4fb0a8aa198c07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198c00 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756156.778881:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c41531800/0x5e4fb0a8aa198c07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198c00 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756156.778902:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41531800, rc 0) 00000100:00100000:3.0:1782756156.778951:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:5800:x1869355222592512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756156.778957:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1782756156.778988:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222592512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782756156.778999:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c41530200/0x5e4fb0a8aa198c00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198c07 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756156.779008:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c41530200/0x5e4fb0a8aa198c00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198c07 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756156.779051:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222592640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782756156.779095:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756156.779105:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a176180 going to sleep for 11 seconds 00000100:00100000:3.0:1782756156.779122:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222592640 00000100:00100000:3.0:1782756156.779126:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222592640 00000100:00100000:3.0:1782756156.779142:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1782756156.779149:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:5800:x1869355222592640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782756156.779399:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:5800:x1869355222592640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756156.779406:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1782756156.779427:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222592640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782756156.779453:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222592768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782756156.779488:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756156.779503:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a176180 going to sleep for 11 seconds 00000100:00100000:3.0:1782756156.779519:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222592768 00000100:00100000:3.0:1782756156.779522:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222592768 00000100:00100000:3.0:1782756156.779539:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1782756156.779546:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:5800:x1869355222592768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782756156.779707:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:5800:x1869355222592768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756156.779714:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1782756156.779743:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222592768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782756156.779913:0:8324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8324:1869355222592896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782756156.779949:0:8324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756156.779966:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222592896 00000100:00100000:3.0:1782756156.779970:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222592896 00000100:00100000:3.0:1782756156.779985:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1782756156.779990:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:8324:x1869355222592896:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782756156.780156:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:8324:x1869355222592896:12345-0@lo:502:llog_process_th.0 Request processed in 165us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756156.780164:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1782756156.780192:0:8324:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a176cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782756156.780204:0:8324:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8324:1869355222592896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782756156.780242:0:8324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8324:1869355222593024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782756156.780274:0:8324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756156.780292:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222593024 00000100:00100000:3.0:1782756156.780296:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222593024 00000100:00100000:3.0:1782756156.780312:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1782756156.780318:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:8324:x1869355222593024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782756156.780458:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:8324:x1869355222593024:12345-0@lo:502:llog_process_th.0 Request processed in 139us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756156.780465:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1782756156.780491:0:8324:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a176cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782756156.780503:0:8324:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8324:1869355222593024:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1782756156.780519:0:8324:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1782756156.780559:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1782756156.780573:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782756156.780581:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41530200/0x5e4fb0a8aa198c00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198c07 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756156.780591:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c41530200/0x5e4fb0a8aa198c00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198c07 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782756156.780600:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1782756156.780602:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1782756156.780605:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1782756156.780625:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198c0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756156.780633:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198c0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756156.780642:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198c0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756156.780656:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222593152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782756156.780681:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756156.780701:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78a010c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782756156.780713:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222593152 00000100:00100000:3.0:1782756156.780716:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222593152 00000100:00100000:3.0:1782756156.780733:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1782756156.780739:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:5800:x1869355222593152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782756156.780747:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756156.780757:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c41530800/0x5e4fb0a8aa198c15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198c0e expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756156.780775:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c41530800/0x5e4fb0a8aa198c15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198c0e expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756156.780783:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c41530800/0x5e4fb0a8aa198c15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198c0e expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756156.780791:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41530800, rc 0) 00000100:00100000:3.0:1782756156.780819:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:5800:x1869355222593152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756156.780825:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1782756156.780860:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222593152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782756156.780870:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198c0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198c15 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756156.780879:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198c0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198c15 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756156.780916:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222593280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782756156.780940:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756156.780963:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78a010c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782756156.780975:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222593280 00000100:00100000:3.0:1782756156.780978:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222593280 00000100:00100000:3.0:1782756156.780998:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1782756156.781004:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:5800:x1869355222593280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782756156.781196:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:5800:x1869355222593280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 191us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756156.781203:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1782756156.781231:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222593280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782756156.781254:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222593408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782756156.781287:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756156.781300:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78a010c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782756156.781311:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222593408 00000100:00100000:3.0:1782756156.781315:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222593408 00000100:00100000:3.0:1782756156.781331:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1782756156.781336:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:5800:x1869355222593408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782756156.785456:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:5800:x1869355222593408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4109us (4158us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756156.785470:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1782756156.788066:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222593408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782756156.788521:0:8325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c50164380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8325:1869355222593536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782756156.788593:0:8325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756156.788640:0:8325:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c44e43900 going to sleep for 11 seconds 00000100:00100000:3.0:1782756156.788689:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222593536 00000100:00100000:3.0:1782756156.788696:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222593536 00000100:00100000:3.0:1782756156.788799:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1782756156.788808:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:8325:x1869355222593536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782756156.789058:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:8325:x1869355222593536:12345-0@lo:502:llog_process_th.0 Request processed in 250us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756156.789066:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1782756156.789316:0:8325:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c50164380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8325:1869355222593536:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782756156.789340:0:8325:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782756156.789349:0:8325:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756156.789351:0:8325:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1782756156.789357:0:8325:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1782756156.789394:0:8325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c50164380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8325:1869355222593664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782756156.789435:0:8325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756156.793493:0:8325:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c44e43900 going to sleep for 11 seconds 00000100:00100000:0.0:1782756156.793833:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222593664 00000100:00100000:0.0:1782756156.793843:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222593664 00000100:00100000:0.0:1782756156.793895:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1782756156.793904:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:8325:x1869355222593664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782756156.794208:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:8325:x1869355222593664:12345-0@lo:502:llog_process_th.0 Request processed in 303us (4770us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756156.794216:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1782756156.795767:0:8325:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c50164380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8325:1869355222593664:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782756156.795815:0:8325:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782756156.795826:0:8325:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756156.795828:0:8325:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1782756156.795833:0:8325:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1782756156.796011:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1782756156.796033:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1782756156.796042:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198c0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198c15 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756156.796054:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198c0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198c15 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782756156.796064:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782756156.796066:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9d3c4505a800 from 39 10000000:01000000:0.0:1782756156.796069:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782756156.796132:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b600/0x5e4fb0a8aa198c1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756156.796140:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b600/0x5e4fb0a8aa198c1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756156.796149:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b600/0x5e4fb0a8aa198c1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756156.796170:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222593792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782756156.796223:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756156.796269:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3b4116f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782756156.796341:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222593792 00000100:00100000:2.0:1782756156.796348:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222593792 00000100:00100000:2.0:1782756156.796394:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1782756156.796401:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:5800:x1869355222593792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782756156.796415:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756156.796427:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4a63c400/0x5e4fb0a8aa198c23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198c1c expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756156.796449:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4a63c400/0x5e4fb0a8aa198c23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198c1c expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756156.796459:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4a63c400/0x5e4fb0a8aa198c23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198c1c expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756156.796468:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63c400, rc 0) 00000100:00100000:2.0:1782756156.796503:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:5800:x1869355222593792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756156.796510:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1782756156.796681:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222593792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782756156.796694:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b600/0x5e4fb0a8aa198c1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198c23 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756156.796702:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b600/0x5e4fb0a8aa198c1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198c23 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756156.796747:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222593920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782756156.796771:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756156.796796:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3b4116f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782756156.796839:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222593920 00000100:00100000:2.0:1782756156.796843:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222593920 00000100:00100000:2.0:1782756156.796859:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1782756156.796865:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:5800:x1869355222593920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782756156.797142:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:5800:x1869355222593920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 277us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756156.797149:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1782756156.797252:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222593920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782756156.797279:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222594048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782756156.797313:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756156.797337:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3b4116f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782756156.797407:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222594048 00000100:00100000:3.0:1782756156.797412:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222594048 00000100:00100000:3.0:1782756156.797435:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1782756156.797442:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:5800:x1869355222594048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782756156.797581:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:5800:x1869355222594048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756156.797587:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1782756156.797659:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222594048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782756156.798066:0:8326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c50164380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8326:1869355222594176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782756156.798129:0:8326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756156.798146:0:8326:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c44e433c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782756156.798232:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222594176 00000100:00100000:1.0:1782756156.798237:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222594176 00000100:00100000:1.0:1782756156.798262:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1782756156.798269:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:8326:x1869355222594176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782756156.798449:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:8326:x1869355222594176:12345-0@lo:502:llog_process_th.0 Request processed in 180us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756156.798456:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1782756156.798544:0:8326:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c50164380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8326:1869355222594176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782756156.798583:0:8326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c50164380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8326:1869355222594304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782756156.798614:0:8326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756156.798639:0:8326:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c44e433c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782756156.798723:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222594304 00000100:00100000:3.0:1782756156.798727:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222594304 00000100:00100000:3.0:1782756156.798744:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1782756156.798750:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:8326:x1869355222594304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782756156.798880:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:8326:x1869355222594304:12345-0@lo:502:llog_process_th.0 Request processed in 129us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756156.798887:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1782756156.799029:0:8326:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c50164380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8326:1869355222594304:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1782756156.799048:0:8326:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1782756156.799342:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1782756156.799359:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782756156.799378:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b600/0x5e4fb0a8aa198c1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198c23 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756156.799388:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b600/0x5e4fb0a8aa198c1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198c23 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782756156.799396:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1782756156.799398:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1782756156.799402:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782756156.799426:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198c2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756156.799434:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198c2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756156.799448:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198c2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756156.799463:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222594432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782756156.799494:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756156.799524:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78a010c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782756156.799586:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222594432 00000100:00100000:2.0:1782756156.799591:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222594432 00000100:00100000:2.0:1782756156.800322:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1782756156.800334:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:5800:x1869355222594432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782756156.800346:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756156.800371:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4a63ce00/0x5e4fb0a8aa198c31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198c2a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756156.800396:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4a63ce00/0x5e4fb0a8aa198c31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198c2a expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756156.800406:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4a63ce00/0x5e4fb0a8aa198c31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198c2a expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756156.800429:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63ce00, rc 0) 00000100:00100000:2.0:1782756156.800476:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:5800:x1869355222594432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756156.800482:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1782756156.800566:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222594432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782756156.800579:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198c2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198c31 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756156.800589:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198c2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198c31 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756156.800641:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222594560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782756156.800671:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756156.801424:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78a010c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782756156.801461:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222594560 00000100:00100000:1.0:1782756156.801468:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222594560 00000100:00100000:2.0:1782756156.801513:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1782756156.801522:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:5800:x1869355222594560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782756156.801787:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:5800:x1869355222594560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 266us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756156.801794:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1782756156.801852:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222594560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782756156.801884:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222594688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782756156.801924:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756156.802769:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78a010c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782756156.802803:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222594688 00000100:00100000:0.0:1782756156.802809:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222594688 00000100:00100000:0.0:1782756156.802841:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1782756156.802848:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:5800:x1869355222594688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782756156.806563:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:5800:x1869355222594688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3705us (4628us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756156.806577:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1782756156.807824:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222594688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782756156.809913:0:8327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8327:1869355222594816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782756156.810011:0:8327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756156.810050:0:8327:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a1433c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782756156.810178:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222594816 00000100:00100000:0.0:1782756156.810186:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222594816 00000100:00100000:0.0:1782756156.810229:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1782756156.810245:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:8327:x1869355222594816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782756156.810595:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:8327:x1869355222594816:12345-0@lo:502:llog_process_th.0 Request processed in 350us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756156.810603:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1782756156.810695:0:8327:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8327:1869355222594816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782756156.810724:0:8327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782756156.810739:0:8327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782756156.810742:0:8327:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1782756156.810748:0:8327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1782756156.810771:0:8327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8327:1869355222594944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782756156.810807:0:8327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756156.810838:0:8327:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78a010c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782756156.810987:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222594944 00000100:00100000:1.0:1782756156.810993:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222594944 00000100:00100000:1.0:1782756156.811017:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1782756156.811024:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:8327:x1869355222594944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782756156.811178:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:8327:x1869355222594944:12345-0@lo:502:llog_process_th.0 Request processed in 153us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756156.811189:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1782756156.811310:0:8327:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8327:1869355222594944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782756156.811326:0:8327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782756156.811329:0:8327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782756156.811331:0:8327:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1782756156.811335:0:8327:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1782756156.811522:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1782756156.811540:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1782756156.811550:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198c2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198c31 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756156.811560:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198c2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198c31 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756156.811570:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1782756156.811572:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9d3c4aba3380 from 1 10000000:01000000:1.0:1782756156.811575:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1782756156.811600:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41497c00/0x5e4fb0a8aa198c38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756156.811607:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c41497c00/0x5e4fb0a8aa198c38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756156.811616:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c41497c00/0x5e4fb0a8aa198c38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756156.811630:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222595072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782756156.811655:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756156.811711:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c46826840 going to sleep for 11 seconds 00000100:00100000:3.0:1782756156.812242:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222595072 00000100:00100000:3.0:1782756156.812249:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222595072 00000100:00100000:3.0:1782756156.812278:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1782756156.812285:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:5800:x1869355222595072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782756156.812295:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756156.812309:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4168d000/0x5e4fb0a8aa198c3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198c38 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756156.812333:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4168d000/0x5e4fb0a8aa198c3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198c38 expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756156.812344:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4168d000/0x5e4fb0a8aa198c3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198c38 expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756156.812359:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168d000, rc 0) 00000100:00100000:3.0:1782756156.812452:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:5800:x1869355222595072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756156.812459:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1782756156.812643:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222595072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782756156.812658:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c41497c00/0x5e4fb0a8aa198c38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198c3f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756156.812677:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c41497c00/0x5e4fb0a8aa198c38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198c3f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756156.812731:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222595200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782756156.812761:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756156.812826:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c46826840 going to sleep for 11 seconds 00000100:00100000:3.0:1782756156.812858:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222595200 00000100:00100000:3.0:1782756156.812862:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222595200 00000100:00100000:3.0:1782756156.812918:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1782756156.812926:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:5800:x1869355222595200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782756156.813723:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:5800:x1869355222595200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 795us (958us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782756156.813732:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1782756156.813809:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222595200:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1782756156.813838:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1782756156.813848:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41497c00/0x5e4fb0a8aa198c38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198c3f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756156.813857:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c41497c00/0x5e4fb0a8aa198c38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198c3f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756156.879183:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782756157.697658:0:8364:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffffd20d5d0 20000000:00000080:3.0:1782756157.697680:0:8364:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d3c76f5ec00 uarg=0000000000000000 20000000:01000000:3.0:1782756157.697720:0:8364:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1782756157.697726:0:8364:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1782756157.697731:0:8364:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1782756157.698514:0:8365:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1782756157.698716:0:8364:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1782756157.704952:0:8364:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1782756157.705013:0:8364:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1782756157.705061:0:8364:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1782756157.705180:0:8364:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1782756157.705199:0:8364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa198c46 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756157.705468:0:8364:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c41531e00/0x5e4fb0a8aa198a0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198a08 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756157.705476:0:8364:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c41496c00/0x5e4fb0a8aa198a8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198a86 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756157.705482:0:8364:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c41497200/0x5e4fb0a8aa198ae8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198ae1 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756157.705490:0:8364:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa198ba5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdd9f expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756157.705507:0:8364:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa198c46 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756157.705548:0:8364:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa198ba5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdd9f expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756157.705563:0:8364:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa198ba5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdd9f expref: 9 pid: 5797 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756157.705579:0:8364:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8364:1869355222595328:192.168.204.25@tcp:104: 00010000:00010000:3.0:1782756157.705691:0:8364:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c41497200/0x5e4fb0a8aa198ae8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa198ae1 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756157.705700:0:8364:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d3c41497200/0x5e4fb0a8aa198ae8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198ae1 expref: 18 pid: 5796 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756157.705708:0:8364:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8364:1869355222595456:0@lo:104: 00000100:00100000:3.0:1782756157.707226:0:8364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756157.707283:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222595456 00000100:00100000:0.0:1782756157.707291:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222595456 00000100:00100000:0.0:1782756157.707357:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782756157.707367:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+3:8364:x1869355222595456:12345-0@lo:104: 00010000:00010000:0.0:1782756157.707383:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: ffff9d3c40030c00/0x5e4fb0a8aa198ae1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198ae8 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756157.710157:0:8364:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c41496c00/0x5e4fb0a8aa198a8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa198a86 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756157.710175:0:8364:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d3c41496c00/0x5e4fb0a8aa198a8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a86 expref: 18 pid: 5797 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756157.710190:0:8364:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8364:1869355222595584:0@lo:104: 00000100:00100000:3.0:1782756157.710436:0:8364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782756157.710472:0:8364:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c41531e00/0x5e4fb0a8aa198a0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa198a08 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756157.710498:0:8364:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d3c41531e00/0x5e4fb0a8aa198a0f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a08 expref: 18 pid: 5797 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756157.710507:0:8364:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8364:1869355222595712:0@lo:104: 00000100:00100000:3.0:1782756157.710529:0:8364:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a1760c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782756157.711437:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782756157.711462:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756157.711500:0:8364:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8364:1869355222595328:192.168.204.25@tcp:104: 00000100:00100000:2.0:1782756157.711829:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756157.711910:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209987200 00000100:00100000:3.0:1782756157.711917:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209987200 00010000:00010000:3.0:1782756157.711953:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa198ba5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdd9f expref: 10 pid: 5797 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756157.712036:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 21 00000100:00100000:3.0:1782756157.712047:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c50164380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:2355:x1869355209987200:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782756157.712063:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756157.712070:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa198ba5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdd9f expref: 10 pid: 5797 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756157.712269:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa198ba5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdd9f expref: 10 pid: 5797 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756157.712308:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa198ba5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdd9f expref: 10 pid: 5797 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756157.712323:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782756157.712388:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c50164380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+9:2355:x1869355209987200:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 342us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756157.712396:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 21 00000100:00100000:1.0:1782756157.712477:0:5786:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1782756157.712484:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:1.0:1782756157.712983:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222595584 00000100:00100000:1.0:1782756157.712990:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222595584 00000100:00100000:1.0:1782756157.713014:0:5786:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1782756157.713019:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222595712 00000100:00100000:1.0:1782756157.713022:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222595712 00000100:00100000:2.0:1782756157.713060:0:8366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782756157.713068:0:8366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+5:8364:x1869355222595584:12345-0@lo:104: 00010000:00010000:2.0:1782756157.713103:0:8366:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: ffff9d3c41531a00/0x5e4fb0a8aa198a86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198a8d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756157.713163:0:8366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782756157.713168:0:8366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+5:8364:x1869355222595584:12345-0@lo:104: Request processed in 102us (2735us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756157.713174:0:8366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782756157.713189:0:8366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782756157.713195:0:8366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+4:8364:x1869355222595712:12345-0@lo:104: 00010000:00010000:2.0:1782756157.713264:0:8366:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: ffff9d3c4168c400/0x5e4fb0a8aa198a08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198a0f expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756157.713322:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782756157.713329:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c41531a00/0x5e4fb0a8aa198a86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198a8d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756157.713358:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41531a00 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:1.0:1782756157.713362:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41531a00/0x5e4fb0a8aa198a86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa198a8d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756157.713370:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c41531a00/0x5e4fb0a8aa198a86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa198a8d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782756157.713377:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41531a00/0x5e4fb0a8aa198a86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa198a8d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756157.713383:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782756157.713415:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c41531a00/0x5e4fb0a8aa198a86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198a8d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756157.713422:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782756157.713439:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c41531a00/0x5e4fb0a8aa198a86 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198a8d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756157.713446:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c41531a00/0x5e4fb0a8aa198a86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198a8d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756157.713457:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756157.713459:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756157.713461:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756157.713468:0:8366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782756157.713478:0:8366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+4:8364:x1869355222595712:12345-0@lo:104: Request processed in 284us (2017us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756157.713478:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222595840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782756157.713485:0:8366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782756157.713512:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782756157.713553:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782756157.713557:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c4168c400/0x5e4fb0a8aa198a08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198a0f expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756157.713559:0:8364:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8364:1869355222595584:0@lo:104: 00000100:00100000:3.0:1782756157.713569:0:8364:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8364:1869355222595712:0@lo:104: 00010000:00010000:1.0:1782756157.713574:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168c400 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:1.0:1782756157.713577:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4168c400/0x5e4fb0a8aa198a08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa198a0f expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756157.713584:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c4168c400/0x5e4fb0a8aa198a08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa198a0f expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782756157.713590:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4168c400/0x5e4fb0a8aa198a08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa198a0f expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756157.713595:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1782756157.713607:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222595840 00000100:00100000:2.0:1782756157.713611:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222595840 00010000:00010000:1.0:1782756157.713621:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c4168c400/0x5e4fb0a8aa198a08 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198a0f expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756157.713626:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782756157.713627:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c41496c00/0x5e4fb0a8aa198a8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a86 expref: 19 pid: 5797 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756157.713642:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c4168c400/0x5e4fb0a8aa198a08 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198a0f expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756157.713644:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1782756157.713649:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c4168c400/0x5e4fb0a8aa198a08 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198a0f expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756157.713650:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3317:x1869355222595840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782756157.713658:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756157.713659:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756157.713660:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756157.713662:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756157.713663:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c41496c00/0x5e4fb0a8aa198a8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a86 expref: 19 pid: 5797 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756157.713669:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0daec403-69b6-4c98-a0ea-f519ca0a480f:3314:1869355222595968:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782756157.713671:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c41496c00/0x5e4fb0a8aa198a8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a86 expref: 19 pid: 5797 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756157.713684:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c41496c00/0x5e4fb0a8aa198a8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a86 expref: 19 pid: 5797 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756157.713693:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782756157.713697:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782756157.713722:0:5788:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1782756157.713723:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:3317:x1869355222595840:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756157.713727:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1782756157.713729:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782756157.713739:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222595968 00000100:00100000:1.0:1782756157.713743:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222595840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782756157.713928:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222595968 00010000:00010000:2.0:1782756157.713947:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c41531e00/0x5e4fb0a8aa198a0f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a08 expref: 18 pid: 5797 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756157.713973:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782756157.713986:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:3314:x1869355222595968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782756157.713994:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756157.713999:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c41531e00/0x5e4fb0a8aa198a0f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a08 expref: 18 pid: 5797 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756157.714006:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c41531e00/0x5e4fb0a8aa198a0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a08 expref: 18 pid: 5797 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756157.714016:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c41531e00/0x5e4fb0a8aa198a0f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa198a08 expref: 18 pid: 5797 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756157.714024:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756157.714105:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:3314:x1869355222595968:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756157.714111:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1782756157.714249:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782756157.714256:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+3:8364:x1869355222595456:12345-0@lo:104: Request processed in 6891us (7035us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756157.714401:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1782756157.714444:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782756157.714449:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c40030c00/0x5e4fb0a8aa198ae1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198ae8 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756157.714456:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c40030c00 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:0.0:1782756157.714463:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c40030c00/0x5e4fb0a8aa198ae1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa198ae8 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756157.714471:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c40030c00/0x5e4fb0a8aa198ae1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa198ae8 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782756157.714478:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c40030c00/0x5e4fb0a8aa198ae1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa198ae8 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782756157.714494:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782756157.714515:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c40030c00/0x5e4fb0a8aa198ae1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198ae8 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756157.714521:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782756157.714530:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c40030c00/0x5e4fb0a8aa198ae1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198ae8 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756157.714537:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c40030c00/0x5e4fb0a8aa198ae1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198ae8 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756157.714552:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756157.714553:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756157.714555:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756157.714563:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0daec403-69b6-4c98-a0ea-f519ca0a480f:3315:1869355222596096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782756157.714588:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756157.714619:0:8367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222596096 00000100:00100000:0.0:1782756157.714623:0:8367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222596096 00010000:00010000:0.0:1782756157.714639:0:8367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c41497200/0x5e4fb0a8aa198ae8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198ae1 expref: 17 pid: 5796 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756157.714660:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782756157.714667:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c809f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:3315:x1869355222596096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782756157.714674:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756157.714678:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c41497200/0x5e4fb0a8aa198ae8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198ae1 expref: 17 pid: 5796 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756157.714687:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c41497200/0x5e4fb0a8aa198ae8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198ae1 expref: 17 pid: 5796 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756157.714704:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa198c46 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756157.714712:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa198c46 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756157.714723:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa198c46 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756157.714730:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa198c46 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756157.714737:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa198c46 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756157.714743:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa198c46 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756157.714748:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168c200 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:0.0:1782756157.714751:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa198c46 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756157.714758:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa198c46 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756157.714766:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa198c46 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756157.714774:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756157.714798:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c809f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:3315:x1869355222596096:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756157.714813:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782756157.714836:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0daec403-69b6-4c98-a0ea-f519ca0a480f:3315:1869355222596096:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782756157.714927:0:8364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c41497200/0x5e4fb0a8aa198ae8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa198ae1 expref: 16 pid: 5796 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756157.714938:0:8364:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8364:1869355222595456:0@lo:104: 00010000:00010000:1.0:1782756157.714959:0:8364:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa198c46 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756157.714968:0:8364:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa198c46 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756157.714974:0:8364:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa198c46 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756157.714980:0:8364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4168c200/0x5e4fb0a8aa198c46 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756157.717249:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0daec403-69b6-4c98-a0ea-f519ca0a480f:3314:1869355222595968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782756157.718898:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756157.718965:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209987328 00000100:00100000:0.0:1782756157.718973:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209987328 00000100:00100000:0.0:1782756157.719027:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 166 00000100:00100000:0.0:1782756157.719037:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+9:5580:x1869355209987328:12345-192.168.204.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782756157.719054:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756157.719103:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4b81a400/0x5e4fb0a8aa198c4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cddde expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756157.719133:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4b81a400/0x5e4fb0a8aa198c4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cddde expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756157.719145:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4b81a400/0x5e4fb0a8aa198c4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cddde expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756157.719153:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81a400, rc 0) 00000100:00100000:0.0:1782756157.719210:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:5580:x1869355209987328:12345-192.168.204.25@tcp:101:ll_cfg_requeue.0 Request processed in 174us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756157.719217:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 166 00000100:00100000:0.0:1782756157.732176:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756157.732210:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209987456 00000100:00100000:3.0:1782756157.732220:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209987456 00000100:00100000:3.0:1782756157.732272:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 167 00000100:00100000:3.0:1782756157.732282:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:5580:x1869355209987456:12345-192.168.204.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782756157.732723:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:5580:x1869355209987456:12345-192.168.204.25@tcp:501:ll_cfg_requeue.0 Request processed in 440us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756157.732731:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 167 00000100:00100000:2.0:1782756157.747850:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756157.748013:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209987584 00000100:00100000:0.0:1782756157.748025:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209987584 00000100:00100000:0.0:1782756157.748124:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 168 00000100:00100000:0.0:1782756157.748134:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:5580:x1869355209987584:12345-192.168.204.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782756157.748627:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:5580:x1869355209987584:12345-192.168.204.25@tcp:503:ll_cfg_requeue.0 Request processed in 492us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756157.748641:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 168 00000100:00100000:2.0:1782756157.771487:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756157.771678:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209987712 00000100:00100000:0.0:1782756157.771689:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209987712 00000100:00100000:0.0:1782756157.771749:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 169 00000100:00100000:0.0:1782756157.771760:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:6063:x1869355209987712:12345-192.168.204.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782756157.772030:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:6063:x1869355209987712:12345-192.168.204.25@tcp:502:llog_process_th.0 Request processed in 271us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756157.772039:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 169 00000100:00100000:0.0:1782756157.781126:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756157.781261:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209987840 00000100:00100000:3.0:1782756157.781272:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209987840 00000100:00100000:3.0:1782756157.781373:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 170 00000100:00100000:3.0:1782756157.781384:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:6063:x1869355209987840:12345-192.168.204.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782756157.781657:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:6063:x1869355209987840:12345-192.168.204.25@tcp:502:llog_process_th.0 Request processed in 274us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756157.781665:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 170 00010000:00010000:1.0:1782756157.900301:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756158.926349:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782756158.988507:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782756158.988517:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9d3c80977000 from 4 10000000:01000000:3.0:1782756158.988522:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782756158.988582:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d600/0x5e4fb0a8aa198c54 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756158.988595:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d600/0x5e4fb0a8aa198c54 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756158.988608:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d600/0x5e4fb0a8aa198c54 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756158.988651:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222596224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782756158.988727:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756158.988970:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4b962f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782756158.989117:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222596224 00000100:00100000:2.0:1782756158.989126:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222596224 00000100:00100000:2.0:1782756158.989182:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1782756158.989192:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:5800:x1869355222596224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782756158.989207:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756158.989221:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4a63dc00/0x5e4fb0a8aa198c5b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198c54 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756158.989245:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4a63dc00/0x5e4fb0a8aa198c5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198c54 expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756158.989256:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4a63dc00/0x5e4fb0a8aa198c5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198c54 expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756158.989273:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63dc00, rc 0) 00000100:00100000:2.0:1782756158.989330:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:5800:x1869355222596224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756158.989337:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1782756158.989442:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222596224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782756158.989456:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d600/0x5e4fb0a8aa198c54 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198c5b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756158.989465:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d600/0x5e4fb0a8aa198c54 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198c5b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756158.989519:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222596352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782756158.989550:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756158.989582:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4b962f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782756158.989709:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222596352 00000100:00100000:0.0:1782756158.989715:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222596352 00000100:00100000:0.0:1782756158.989758:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1782756158.989766:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:5800:x1869355222596352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782756158.990024:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:5800:x1869355222596352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756158.990031:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1782756158.990115:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222596352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782756158.990142:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222596480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782756158.990180:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756158.990205:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4b962f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782756158.990380:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222596480 00000100:00100000:2.0:1782756158.990385:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222596480 00000100:00100000:2.0:1782756158.990417:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1782756158.990434:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:5800:x1869355222596480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782756158.990587:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:5800:x1869355222596480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756158.990594:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1782756158.990780:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222596480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782756158.991239:0:8434:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8434:1869355222596608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782756158.991282:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756158.991313:0:8434:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a04bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1782756158.991356:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222596608 00000100:00100000:0.0:1782756158.991361:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222596608 00000100:00100000:0.0:1782756158.991394:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1782756158.991401:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:8434:x1869355222596608:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782756158.991587:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:8434:x1869355222596608:12345-0@lo:502:llog_process_th.0 Request processed in 185us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756158.991604:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1782756158.992914:0:8434:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8434:1869355222596608:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782756158.992955:0:8434:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782756158.992966:0:8434:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782756158.992969:0:8434:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782756158.992984:0:8434:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d3c80977000 00000020:00000080:3.0:1782756158.992987:0:8434:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782756158.993101:0:8434:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8434:1869355222596736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782756158.993154:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756158.993290:0:8434:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a04bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1782756158.995825:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222596736 00000100:00100000:0.0:1782756158.995839:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222596736 00000100:00100000:0.0:1782756158.995960:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1782756158.995970:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:8434:x1869355222596736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782756158.997404:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:8434:x1869355222596736:12345-0@lo:502:llog_process_th.0 Request processed in 1431us (4245us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756158.997414:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1782756158.999039:0:8434:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8434:1869355222596736:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782756158.999102:0:8434:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782756158.999112:0:8434:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782756158.999115:0:8434:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1782756158.999119:0:8434:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1782756159.000156:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1782756159.000248:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782756159.000260:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d600/0x5e4fb0a8aa198c54 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198c5b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756159.000271:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d600/0x5e4fb0a8aa198c54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198c5b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756159.000281:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782756159.000283:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9d3c4a734800 from 4 10000000:01000000:1.0:1782756159.000286:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782756159.000331:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198c62 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756159.000345:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198c62 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756159.000356:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198c62 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756159.000379:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222596864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782756159.000440:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756159.000485:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a7649c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782756159.000542:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222596864 00000100:00100000:3.0:1782756159.000550:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222596864 00000100:00100000:3.0:1782756159.000588:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1782756159.000597:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:5800:x1869355222596864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782756159.000611:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756159.000624:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198c69 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198c62 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756159.000646:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198c69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198c62 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756159.000657:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198c69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198c62 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756159.000666:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168d200, rc 0) 00000100:00100000:3.0:1782756159.000716:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:5800:x1869355222596864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756159.000723:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1782756159.000883:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222596864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782756159.000898:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198c62 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198c69 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756159.000907:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198c62 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198c69 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756159.000957:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222596992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782756159.000984:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756159.001012:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a7649c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782756159.001053:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222596992 00000100:00100000:3.0:1782756159.001062:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222596992 00000100:00100000:3.0:1782756159.001110:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1782756159.001117:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:5800:x1869355222596992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782756159.001461:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:5800:x1869355222596992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 343us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756159.001468:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1782756159.001571:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222596992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782756159.001602:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222597120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782756159.001640:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756159.001660:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a7649c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782756159.001671:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222597120 00000100:00100000:1.0:1782756159.001675:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222597120 00000100:00100000:1.0:1782756159.001704:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1782756159.001711:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:5800:x1869355222597120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782756159.001950:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:5800:x1869355222597120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 239us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756159.001956:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1782756159.001993:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222597120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782756159.002539:0:8437:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8437:1869355222597248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782756159.002584:0:8437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756159.002620:0:8437:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78ef9480 going to sleep for 11 seconds 00000100:00100000:1.0:1782756159.002738:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222597248 00000100:00100000:1.0:1782756159.002745:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222597248 00000100:00100000:1.0:1782756159.002782:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1782756159.002789:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:8437:x1869355222597248:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782756159.003102:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:8437:x1869355222597248:12345-0@lo:502:llog_process_th.0 Request processed in 312us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756159.003111:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1782756159.003198:0:8437:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8437:1869355222597248:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782756159.003226:0:8437:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782756159.003236:0:8437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782756159.003239:0:8437:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1782756159.003245:0:8437:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d3c4a734800 00000020:00000080:0.0:1782756159.003248:0:8437:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1782756159.003349:0:8437:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8437:1869355222597376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782756159.003386:0:8437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756159.003415:0:8437:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78ef9480 going to sleep for 11 seconds 00000100:00100000:1.0:1782756159.003622:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222597376 00000100:00100000:1.0:1782756159.003627:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222597376 00000100:00100000:1.0:1782756159.003661:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1782756159.003668:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:8437:x1869355222597376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782756159.003786:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:8437:x1869355222597376:12345-0@lo:502:llog_process_th.0 Request processed in 118us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756159.003793:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1782756159.003940:0:8437:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8437:1869355222597376:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782756159.003959:0:8437:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782756159.003964:0:8437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782756159.003965:0:8437:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1782756159.003969:0:8437:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1782756159.004157:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1782756159.004174:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782756159.004185:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198c62 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198c69 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756159.004196:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198c62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198c69 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756159.004212:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782756159.004215:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9d3c4505a800 from 4 10000000:01000000:1.0:1782756159.004218:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782756159.004242:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41497e00/0x5e4fb0a8aa198c70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756159.004250:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c41497e00/0x5e4fb0a8aa198c70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756159.004259:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c41497e00/0x5e4fb0a8aa198c70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756159.004273:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222597504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782756159.004303:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756159.004926:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76c123c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782756159.004974:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222597504 00000100:00100000:0.0:1782756159.004986:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222597504 00000100:00100000:0.0:1782756159.005026:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1782756159.005034:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:5800:x1869355222597504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782756159.005045:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756159.005058:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198c77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198c70 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756159.005109:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198c77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198c70 expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756159.005120:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198c77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198c70 expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756159.005129:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81aa00, rc 0) 00000100:00100000:0.0:1782756159.005173:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:5800:x1869355222597504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756159.005179:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1782756159.005216:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222597504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782756159.005230:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c41497e00/0x5e4fb0a8aa198c70 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198c77 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756159.005238:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c41497e00/0x5e4fb0a8aa198c70 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198c77 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756159.005286:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222597632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782756159.005314:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756159.005340:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78ef99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782756159.005353:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222597632 00000100:00100000:0.0:1782756159.005362:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222597632 00000100:00100000:0.0:1782756159.005386:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1782756159.005392:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:5800:x1869355222597632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782756159.005647:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:5800:x1869355222597632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756159.005654:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1782756159.005840:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222597632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782756159.005872:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222597760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782756159.005909:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756159.005934:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a04b780 going to sleep for 11 seconds 00000100:00100000:0.0:1782756159.006218:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222597760 00000100:00100000:0.0:1782756159.006223:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222597760 00000100:00100000:0.0:1782756159.009395:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1782756159.009414:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:5800:x1869355222597760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782756159.009653:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:5800:x1869355222597760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 246us (3743us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756159.009662:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1782756159.010281:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222597760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782756159.012612:0:8438:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8438:1869355222597888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782756159.012693:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756159.012733:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222597888 00000100:00100000:0.0:1782756159.012740:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222597888 00000100:00100000:0.0:1782756159.012787:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1782756159.012796:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:8438:x1869355222597888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782756159.013110:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:8438:x1869355222597888:12345-0@lo:502:llog_process_th.0 Request processed in 315us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756159.013118:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1782756159.013171:0:8438:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78ef9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782756159.013194:0:8438:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8438:1869355222597888:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782756159.013232:0:8438:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782756159.013241:0:8438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782756159.013244:0:8438:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1782756159.013252:0:8438:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d3c4505a800 00000020:00000080:0.0:1782756159.013254:0:8438:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1782756159.013343:0:8438:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8438:1869355222598016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782756159.013377:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756159.013397:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222598016 00000100:00100000:0.0:1782756159.013401:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222598016 00000100:00100000:0.0:1782756159.013423:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1782756159.013676:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:8438:x1869355222598016:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782756159.013923:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:8438:x1869355222598016:12345-0@lo:502:llog_process_th.0 Request processed in 251us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756159.013930:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1782756159.013961:0:8438:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78ef9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782756159.013972:0:8438:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:8438:1869355222598016:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782756159.013990:0:8438:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782756159.013995:0:8438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782756159.013997:0:8438:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1782756159.014001:0:8438:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1782756159.014306:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1782756159.014342:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782756159.014353:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41497e00/0x5e4fb0a8aa198c70 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198c77 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756159.014364:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c41497e00/0x5e4fb0a8aa198c70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198c77 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756159.275696:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756159.275740:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209987968 00000100:00100000:1.0:1782756159.275742:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756159.275754:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209987968 00000100:00100000:1.0:1782756159.275774:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756159.275801:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209988096 00000100:00100000:1.0:1782756159.275805:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209988096 00000100:00100000:0.0:1782756159.275817:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 186 00000100:00100000:0.0:1782756159.275828:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:2357:x1869355209987968:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756159.276207:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209988224 00000100:00100000:3.0:1782756159.276212:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209988224 00000100:00100000:3.0:1782756159.276338:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9 00000100:00100000:3.0:1782756159.276347:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+5:2357:x1869355209988224:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756159.276380:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+5:2357:x1869355209988224:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 35us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756159.276388:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9 00000100:00080000:3.0:1782756159.276411:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782756159.276780:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:2357:x1869355209987968:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 77us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756159.276789:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 186 00000100:00100000:1.0:1782756159.279648:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 21 00000100:00100000:1.0:1782756159.279671:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+6:2357:x1869355209988096:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1782756159.279758:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+6:2357:x1869355209988096:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 90us (4015us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756159.279767:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 21 00000100:00080000:2.0:1782756159.280026:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782756159.282386:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756159.282483:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209988352 00000100:00100000:2.0:1782756159.282493:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209988352 00000100:00100000:2.0:1782756159.282601:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 10 00000100:00100000:2.0:1782756159.282612:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+5:2357:x1869355209988352:12345-192.168.204.25@tcp:400:kworker.0 00000100:00080000:0.0:1782756159.282633:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782756159.282686:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+5:2357:x1869355209988352:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 76us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756159.282693:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 10 00000100:00100000:1.0:1782756159.436254:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222598144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782756159.436337:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756159.440404:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222598144 00000100:00100000:3.0:1782756159.440419:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222598144 00000100:00080000:1.0:1782756159.440479:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782756159.440502:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782756159.440511:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222598144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782756159.440550:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782756159.440635:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222598144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (4298us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756159.440642:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1782756159.440764:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c78ef0a80 x1869355222598144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756175 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756159.440790:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222598144:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782756159.948684:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756160.972293:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869355222598400:0@lo:400:kworker.0 00000100:00100000:1.0:1782756160.972375:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756160.972432:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222598912:0@lo:400:kworker.0 00000100:00100000:1.0:1782756160.972456:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756160.972483:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782756160.972487:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222598528:0@lo:400:kworker.0 00000100:00100000:1.0:1782756160.972505:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756160.972530:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222598400 00000100:00100000:1.0:1782756160.972536:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222598400 00000100:00100000:1.0:1782756160.972572:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222598528 00000100:00100000:1.0:1782756160.972574:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222598528 00000100:00100000:1.0:1782756160.972598:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782756160.972606:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869355222598400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756160.972668:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869355222598400:12345-0@lo:400:kworker.0 Request processed in 60us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756160.972676:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782756160.972695:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782756160.972701:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222598528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756160.972726:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222598528:12345-0@lo:400:kworker.0 Request processed in 26us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756160.972749:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782756160.972771:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222598912 00000100:00100000:1.0:1782756160.972774:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222598912 00000100:00100000:1.0:1782756160.972803:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782756160.972809:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222598912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756160.972838:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222598912:12345-0@lo:400:kworker.0 Request processed in 29us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756160.972844:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1782756160.972860:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782756160.972865:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782756160.972899:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222598528:0@lo:400:kworker.0 00000100:00100000:1.0:1782756160.972910:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869355222598400:0@lo:400:kworker.0 00010000:00080000:1.0:1782756160.972920:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c6a33c380 x1869355222598912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756160.972929:0:3314:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1782756160.972944:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222598912:0@lo:400:kworker.0 00000100:00100000:0.0:1782756160.973236:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222598656:0@lo:400:kworker.0 00000100:00100000:0.0:1782756160.973271:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756160.973303:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782756160.973309:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222598272:0@lo:400:kworker.0 00000100:00100000:0.0:1782756160.973336:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756160.973358:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869355222598784:0@lo:400:kworker.0 00000100:00100000:0.0:1782756160.973393:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756160.973421:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222598784 00000100:00100000:0.0:1782756160.973425:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222598784 00000100:00100000:0.0:1782756160.973462:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782756160.973469:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c809f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869355222598784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756160.973506:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c809f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869355222598784:12345-0@lo:400:kworker.0 Request processed in 37us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756160.973512:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782756160.973544:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222598272 00000100:00100000:0.0:1782756160.973547:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222598272 00000100:00100000:0.0:1782756160.973569:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1782756160.973575:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3316:x1869355222598272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756160.973602:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3316:x1869355222598272:12345-0@lo:400:kworker.0 Request processed in 27us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756160.973608:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:0.0:1782756160.973638:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782756160.973655:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222598272:0@lo:400:kworker.0 00000100:00100000:0.0:1782756160.973665:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869355222598784:0@lo:400:kworker.0 00000100:00100000:1.0:1782756160.974108:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222598656 00000100:00100000:1.0:1782756160.974112:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222598656 00000100:00100000:1.0:1782756160.974155:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782756160.974163:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c809f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222598656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756160.974204:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c809f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222598656:12345-0@lo:400:kworker.0 Request processed in 42us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756160.974210:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782756160.974228:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782756160.974236:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222599040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782756160.974263:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782756160.974549:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756160.974566:0:8071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222599040 00000100:00100000:0.0:1782756160.974570:0:8071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222599040 00000100:00100000:0.0:1782756160.974592:0:8071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782756160.974598:0:8071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222599040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782756160.974624:0:8071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782756160.974659:0:8071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222599040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756160.974665:0:8071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1782756160.974698:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c6a33ca80 x1869355222598656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756160.974709:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222598656:0@lo:400:kworker.0 00010000:00080000:0.0:1782756160.975898:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c78ef3480 x1869355222599040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756160.975918:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222599040:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782756161.996346:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756163.020523:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782756163.168870:0:8665:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg425-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1782756164.045377:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756164.394303:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756164.394347:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756164.394442:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756164.394538:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209988864 00000100:00100000:2.0:1782756164.394549:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209988864 00000100:00100000:2.0:1782756164.394623:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13 00000100:00100000:2.0:1782756164.394634:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+5:2355:x1869355209988864:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:2.0:1782756164.394718:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+5:2355:x1869355209988864:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 85us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756164.394741:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13 00000100:00080000:1.0:1782756164.395631:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782756164.395793:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209988480 00000100:00100000:3.0:1782756164.395801:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209988480 00000100:00100000:3.0:1782756164.395852:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 188 00000100:00100000:3.0:1782756164.395861:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:2355:x1869355209988480:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756164.395918:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:2355:x1869355209988480:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 59us (1476us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756164.395926:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 188 00000100:00100000:3.0:1782756164.395989:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756164.396112:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209988736 00000100:00100000:3.0:1782756164.396116:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209988736 00000100:00100000:3.0:1782756164.396151:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14 00000100:00100000:3.0:1782756164.396157:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+5:2355:x1869355209988736:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756164.396188:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+5:2355:x1869355209988736:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 30us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756164.396194:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14 00000100:00080000:3.0:1782756164.396208:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782756164.396354:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209988608 00000100:00100000:0.0:1782756164.396359:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209988608 00000100:00100000:0.0:1782756164.396410:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 25 00000100:00100000:0.0:1782756164.396421:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+6:2355:x1869355209988608:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756164.396456:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+6:2355:x1869355209988608:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 39us (2171us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756164.396463:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 25 00000100:00080000:3.0:1782756164.396959:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782756164.556392:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782756164.556420:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222599168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782756164.556500:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756164.556777:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222599168 00000100:00100000:1.0:1782756164.556787:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222599168 00000100:00100000:1.0:1782756164.556890:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782756164.556901:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222599168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782756164.556962:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782756164.557032:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222599168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756164.557040:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1782756164.557400:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c6a33ca80 x1869355222599168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756180 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756164.557427:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222599168:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782756164.557660:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782756165.070713:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756166.092405:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222599296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782756166.092779:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782756166.092862:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756166.094355:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222599296 00000100:00100000:1.0:1782756166.094368:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222599296 00000100:00100000:1.0:1782756166.094426:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782756166.094437:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222599296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782756166.094474:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782756166.094541:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222599296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (1763us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756166.094548:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782756166.094729:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0daec403-69b6-4c98-a0ea-f519ca0a480f:3314:1869355222599424:0@lo:400:kworker.0 00000100:00100000:0.0:1782756166.094771:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756166.094804:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782756166.094810:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869355222599552:0@lo:400:kworker.0 00000100:00100000:0.0:1782756166.094884:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756166.094913:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222599424 00000100:00100000:0.0:1782756166.094916:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222599424 00000100:00100000:0.0:1782756166.094944:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1782756166.094950:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3314:x1869355222599424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756166.094982:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3314:x1869355222599424:12345-0@lo:400:kworker.0 Request processed in 32us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756166.094988:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1782756166.095017:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222599552 00000100:00100000:0.0:1782756166.095020:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222599552 00000100:00100000:0.0:1782756166.095045:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782756166.095051:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c809f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869355222599552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756166.095101:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c809f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869355222599552:12345-0@lo:400:kworker.0 Request processed in 50us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756166.095108:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782756166.095147:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869355222599552:0@lo:400:kworker.0 00000100:00100000:0.0:1782756166.095157:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0daec403-69b6-4c98-a0ea-f519ca0a480f:3314:1869355222599424:0@lo:400:kworker.0 00000100:00080000:1.0:1782756166.095336:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782756166.095368:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869355222599680:0@lo:400:kworker.0 00000100:00100000:1.0:1782756166.095395:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756166.095412:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782756166.095418:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222599808:0@lo:400:kworker.0 00000100:00100000:1.0:1782756166.095443:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756166.095468:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222599808 00000100:00100000:1.0:1782756166.095473:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222599808 00000100:00100000:1.0:1782756166.095504:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782756166.095560:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222599808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756166.095611:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222599808:12345-0@lo:400:kworker.0 Request processed in 101us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756166.095617:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1782756166.095636:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782756166.095660:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c809f5880 x1869355222599296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756166.095687:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222599296:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1782756166.095901:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c78fc2a00 x1869355222599808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756166.095911:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222599808:0@lo:400:kworker.0 00000100:00100000:0.0:1782756166.096912:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222599680 00000100:00100000:0.0:1782756166.096921:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222599680 00000100:00100000:0.0:1782756166.096968:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782756166.096978:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869355222599680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756166.097038:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869355222599680:12345-0@lo:400:kworker.0 Request processed in 63us (1641us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756166.097059:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1782756166.097093:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782756166.097105:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782756166.097125:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869355222599936:0@lo:400:kworker.0 00000100:00100000:0.0:1782756166.097156:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756166.097210:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869355222599680:0@lo:400:kworker.0 00000100:00100000:0.0:1782756166.097230:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222599936 00000100:00100000:0.0:1782756166.097233:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222599936 00000100:00100000:0.0:1782756166.097260:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782756166.097267:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c809f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869355222599936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756166.097300:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c809f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869355222599936:12345-0@lo:400:kworker.0 Request processed in 34us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756166.097306:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1782756166.097322:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782756166.097339:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869355222599936:0@lo:400:kworker.0 00010000:00010000:3.0:1782756167.116276:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782756167.474715:0:8909:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg425-server.virtnet: executing yml_node 00010000:00010000:1.0:1782756168.141249:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756169.164361:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756169.512629:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756169.512667:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756169.512696:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756169.512724:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756169.512751:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209989248 00000100:00100000:1.0:1782756169.512760:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209989248 00000100:00100000:1.0:1782756169.512807:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209989376 00000100:00100000:1.0:1782756169.512809:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209989376 00000100:00100000:1.0:1782756169.512825:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16 00000100:00100000:1.0:1782756169.512833:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+5:2357:x1869355209989248:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1782756169.512901:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+5:2357:x1869355209989248:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 69us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756169.512908:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16 00000100:00100000:1.0:1782756169.512921:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17 00000100:00100000:1.0:1782756169.512927:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+5:2357:x1869355209989376:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1782756169.512944:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+5:2357:x1869355209989376:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 17us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756169.512949:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17 00000100:00100000:2.0:1782756169.513211:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209988992 00000100:00100000:0.0:1782756169.513214:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209989120 00000100:00100000:2.0:1782756169.513217:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209988992 00000100:00100000:0.0:1782756169.513217:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209989120 00000100:00100000:0.0:1782756169.513254:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 29 00000100:00100000:2.0:1782756169.513255:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 190 00000100:00100000:2.0:1782756169.513262:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:2357:x1869355209988992:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756169.513262:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+6:2357:x1869355209989120:12345-192.168.204.25@tcp:400:kworker.0 00000100:00080000:1.0:1782756169.513333:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782756169.513337:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782756169.513339:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782756169.513383:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:2357:x1869355209988992:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 122us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756169.513390:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 190 00000100:00100000:0.0:1782756169.519407:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+6:2357:x1869355209989120:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 6129us (6693us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756169.519423:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 29 00000100:00100000:2.0:1782756169.676476:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782756169.676503:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222600064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782756169.676577:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756169.676727:0:8071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222600064 00000100:00100000:3.0:1782756169.676734:0:8071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222600064 00000100:00100000:3.0:1782756169.676810:0:8071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782756169.676820:0:8071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c50166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222600064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782756169.676857:0:8071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782756169.676905:0:8071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c50166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222600064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756169.676912:0:8071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1782756169.676952:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c78fc2680 x1869355222600064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756185 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756169.676970:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222600064:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782756169.677039:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782756170.192333:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756171.216677:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869355222600320:0@lo:400:kworker.0 00000100:00100000:1.0:1782756171.216752:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756171.216905:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222600192:0@lo:400:kworker.0 00000100:00100000:0.0:1782756171.216939:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756171.216963:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222600576:0@lo:400:kworker.0 00000100:00100000:0.0:1782756171.216990:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756171.217019:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222600320 00000100:00100000:0.0:1782756171.217025:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222600320 00000100:00100000:0.0:1782756171.217114:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782756171.217123:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869355222600320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756171.217169:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869355222600320:12345-0@lo:400:kworker.0 Request processed in 47us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756171.217175:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782756171.217214:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222600192 00000100:00100000:0.0:1782756171.217231:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222600192 00000100:00100000:0.0:1782756171.217257:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1782756171.217263:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3316:x1869355222600192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756171.217293:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3316:x1869355222600192:12345-0@lo:400:kworker.0 Request processed in 30us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756171.217300:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1782756171.217322:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222600576 00000100:00100000:0.0:1782756171.217325:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222600576 00000100:00100000:0.0:1782756171.217354:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782756171.217360:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c809f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222600576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756171.217389:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c809f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222600576:12345-0@lo:400:kworker.0 Request processed in 30us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756171.217395:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1782756171.217414:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782756171.218622:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222600448:0@lo:400:kworker.0 00000100:00100000:3.0:1782756171.218678:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782756171.219754:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782756171.220364:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222600448 00000100:00100000:2.0:1782756171.220374:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222600448 00000100:00100000:2.0:1782756171.220442:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782756171.220454:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222600448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756171.220459:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869355222600320:0@lo:400:kworker.0 00000100:00100000:1.0:1782756171.220473:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222600832:0@lo:400:kworker.0 00000100:00100000:2.0:1782756171.220530:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222600448:12345-0@lo:400:kworker.0 Request processed in 79us (1851us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756171.220537:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782756171.220629:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756171.220684:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222600192:0@lo:400:kworker.0 00000100:00100000:1.0:1782756171.220691:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869355222600704:0@lo:400:kworker.0 00000100:00100000:1.0:1782756171.220714:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1782756171.220766:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c78fc0000 x1869355222600576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756171.220777:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222600576:0@lo:400:kworker.0 00000100:00100000:1.0:1782756171.220811:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222600704 00000100:00100000:1.0:1782756171.220815:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222600704 00000100:00100000:1.0:1782756171.220844:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782756171.220851:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869355222600704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756171.220886:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869355222600704:12345-0@lo:400:kworker.0 Request processed in 36us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756171.220891:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782756171.220915:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869355222600704:0@lo:400:kworker.0 00000100:00080000:3.0:1782756171.222147:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782756171.222203:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222600448:0@lo:400:kworker.0 00000100:00100000:3.0:1782756171.222227:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222600960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782756171.222277:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756171.222328:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222600960 00000100:00100000:3.0:1782756171.222333:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222600960 00000100:00100000:3.0:1782756171.222384:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782756171.222393:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222600960:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1782756171.222423:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1782756171.222427:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782756171.222787:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222600832 00000100:00100000:2.0:1782756171.222793:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222600832 00000100:00100000:2.0:1782756171.222835:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782756171.222844:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1869355222600832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756171.222891:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1869355222600832:12345-0@lo:400:kworker.0 Request processed in 49us (2262us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756171.222897:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782756171.225554:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222600960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3154us (3268us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756171.225566:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1782756171.225734:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c809f7800 x1869355222600960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756171.225756:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222600960:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1782756171.225799:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c78fc2a00 x1869355222600832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756171.225809:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222600832:0@lo:400:kworker.0 00000001:02000400:0.0:1782756171.420586:0:9101:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.83 00010000:00010000:1.0:1782756172.239970:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756173.260315:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782756173.723528:0:9198:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.83 00010000:00010000:2.0:1782756174.286071:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756174.662857:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756174.662916:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756174.663071:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209989504 00000100:00100000:2.0:1782756174.663104:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209989504 00000100:00100000:2.0:1782756174.663159:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 192 00000100:00100000:2.0:1782756174.663169:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:2357:x1869355209989504:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:2.0:1782756174.663260:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:2357:x1869355209989504:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 92us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756174.663268:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 192 00000100:00100000:2.0:1782756174.663298:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209989632 00000100:00100000:2.0:1782756174.663301:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209989632 00000100:00100000:2.0:1782756174.663358:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 33 00000100:00100000:2.0:1782756174.663366:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+6:2357:x1869355209989632:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:2.0:1782756174.663396:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+6:2357:x1869355209989632:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 32us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756174.663401:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 33 00000100:00080000:2.0:1782756174.663521:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782756174.666736:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756174.666792:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756174.666901:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209989760 00000100:00100000:3.0:1782756174.666910:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209989760 00000100:00100000:3.0:1782756174.666966:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209989888 00000100:00100000:3.0:1782756174.666969:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209989888 00000100:00100000:3.0:1782756174.666989:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 10 00000100:00100000:3.0:1782756174.666998:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+5:2354:x1869355209989760:12345-192.168.204.25@tcp:9:kworker.0 00000020:00000080:3.0:1782756174.667042:0:6605:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa198bb3 00000100:00080000:3.0:1782756174.667052:0:6605:0:(import.c:65:import_set_state_nolock()) ffff9d3b41d9f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782756174.667118:0:6605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1782756174.667457:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+2:2354:x1869355209989760:12345-192.168.204.25@tcp:9:kworker.0 Request processed in 459us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756174.667465:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 10 00000100:00100000:3.0:1782756174.667480:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 11 00000100:00100000:3.0:1782756174.667486:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+5:2354:x1869355209989888:12345-192.168.204.25@tcp:9:kworker.0 00000020:00000080:3.0:1782756174.667497:0:6605:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa198bba 00000100:00080000:3.0:1782756174.667503:0:6605:0:(import.c:65:import_set_state_nolock()) ffff9d3b41d9f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782756174.667520:0:6605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1782756174.667728:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+2:2354:x1869355209989888:12345-192.168.204.25@tcp:9:kworker.0 Request processed in 241us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756174.667743:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 11 00010000:00010000:3.0:1782756174.667761:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782756174.667950:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782756174.667954:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782756174.668138:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756174.796753:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222601088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782756174.796843:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756174.797038:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222601088 00000100:00100000:2.0:1782756174.797047:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222601088 00000100:00100000:2.0:1782756174.797144:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782756174.797164:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c809f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222601088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782756174.797209:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782756174.797260:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c809f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222601088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756174.797267:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1782756174.797385:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782756174.797451:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c76fd3800 x1869355222601088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756190 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756174.797471:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222601088:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782756175.308225:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782756175.706613:0:9296:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.83 00000001:00100000:1.0:1782756175.902619:0:6627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 26487635-60cb-4aee-af8e-396654f6c3d8 00000020:00000080:1.0:1782756175.902632:0:6627:0:(genops.c:906:class_export_put()) final put ffff9d3b41d9a800/26487635-60cb-4aee-af8e-396654f6c3d8 00000020:00000080:0.0:1782756175.902707:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3b41d9a800/26487635-60cb-4aee-af8e-396654f6c3d8 for lustre-OST0000 00000020:00000080:0.0:1782756175.902914:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d3b41d9f800 for lustre-OST0000 00010000:00010000:0.0:1782756176.332712:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756176.333721:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222601216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782756176.333803:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756176.333890:0:8071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222601216 00000100:00100000:1.0:1782756176.333898:0:8071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222601216 00000100:00100000:1.0:1782756176.333959:0:8071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782756176.333968:0:8071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222601216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782756176.334025:0:8071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782756176.334071:0:8071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222601216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756176.334110:0:8071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1782756176.334150:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782756176.334180:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c809f6d80 x1869355222601216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756176.334199:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222601216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782756176.335061:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222601728:0@lo:400:kworker.0 00000100:00100000:0.0:1782756176.335524:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756176.335553:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782756176.335559:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222601344:0@lo:400:kworker.0 00000100:00100000:0.0:1782756176.335585:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756176.335607:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869355222601856:0@lo:400:kworker.0 00000100:00100000:0.0:1782756176.335630:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756176.335656:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869355222601472:0@lo:400:kworker.0 00000100:00100000:0.0:1782756176.335679:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756176.335696:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782756176.335701:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222601600:0@lo:400:kworker.0 00000100:00100000:0.0:1782756176.335722:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756176.335750:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222601728 00000100:00100000:0.0:1782756176.335756:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222601728 00000100:00100000:0.0:1782756176.335806:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782756176.335818:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222601728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756176.335868:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222601728:12345-0@lo:400:kworker.0 Request processed in 55us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756176.335875:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782756176.335894:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222601344 00000100:00100000:0.0:1782756176.335897:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222601344 00000100:00100000:0.0:1782756176.335918:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1782756176.335924:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3316:x1869355222601344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756176.335966:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3316:x1869355222601344:12345-0@lo:400:kworker.0 Request processed in 42us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756176.335972:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1782756176.336010:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222601856 00000100:00100000:0.0:1782756176.336014:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222601856 00000100:00100000:0.0:1782756176.336043:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222601472 00000100:00100000:0.0:1782756176.336047:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222601472 00000100:00100000:0.0:1782756176.336399:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222601600 00000100:00100000:0.0:1782756176.336404:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222601600 00000100:00100000:0.0:1782756176.336426:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782756176.336433:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869355222601856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756176.336466:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869355222601856:12345-0@lo:400:kworker.0 Request processed in 34us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756176.336472:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782756176.336483:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782756176.336489:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869355222601472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756176.336517:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869355222601472:12345-0@lo:400:kworker.0 Request processed in 27us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756176.336522:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782756176.336533:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782756176.336539:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222601600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756176.336565:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222601600:12345-0@lo:400:kworker.0 Request processed in 26us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756176.336570:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1782756176.336589:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782756176.336593:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782756176.336618:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222601344:0@lo:400:kworker.0 00000100:00100000:0.0:1782756176.336644:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869355222601856:0@lo:400:kworker.0 00010000:00080000:0.0:1782756176.336659:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c809f5880 x1869355222601728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756176.336669:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222601728:0@lo:400:kworker.0 00000100:00100000:0.0:1782756176.336709:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222601600:0@lo:400:kworker.0 00000100:00100000:0.0:1782756176.336719:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869355222601472:0@lo:400:kworker.0 00000001:00100000:0.0:1782756176.362752:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 26487635-60cb-4aee-af8e-396654f6c3d8 00000020:00000080:0.0:1782756176.362762:0:7503:0:(genops.c:906:class_export_put()) final put ffff9d3b41d9b000/26487635-60cb-4aee-af8e-396654f6c3d8 00000020:00000080:1.0:1782756176.362826:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3b41d9b000/26487635-60cb-4aee-af8e-396654f6c3d8 for lustre-OST0001 00000020:00000080:1.0:1782756176.362877:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d3b41d9f000 for lustre-OST0001 00000001:02000400:2.0:1782756176.951849:0:9346:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Jun 29 14:02:55 EDT 2026 00010000:00010000:3.0:1782756177.356334:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756178.383395:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756179.404258:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756179.757558:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756179.757722:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209990016 00000100:00100000:0.0:1782756179.757734:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209990016 00000100:00100000:0.0:1782756179.757797:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 194 00000100:00100000:0.0:1782756179.757808:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:2357:x1869355209990016:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756179.762935:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:2357:x1869355209990016:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 5107us (5365us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756179.762951:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 194 00000100:00100000:1.0:1782756179.764874:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756179.764946:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209990144 00000100:00100000:0.0:1782756179.764957:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209990144 00000100:00100000:0.0:1782756179.765027:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 37 00000100:00100000:0.0:1782756179.765040:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+6:2358:x1869355209990144:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756179.765162:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+6:2358:x1869355209990144:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 125us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756179.765170:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 37 00000100:00080000:1.0:1782756179.766691:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782756179.919396:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782756179.919419:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222601984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782756179.919550:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756179.919690:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222601984 00000100:00100000:1.0:1782756179.919706:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222601984 00000100:00100000:1.0:1782756179.919776:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782756179.919786:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222601984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782756179.919821:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782756179.919872:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222601984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756179.919878:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1782756179.919929:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c76fd2a00 x1869355222601984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756195 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756179.919949:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222601984:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782756179.920066:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782756180.428510:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756181.453212:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222602496:0@lo:400:kworker.0 00000100:00100000:1.0:1782756181.453265:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222602112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782756181.453279:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756181.453293:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756181.453349:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222602240:0@lo:400:kworker.0 00000100:00100000:0.0:1782756181.453380:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756181.453402:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869355222602752:0@lo:400:kworker.0 00000100:00100000:0.0:1782756181.453422:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756181.453440:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782756181.453445:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869355222602368:0@lo:400:kworker.0 00000100:00100000:0.0:1782756181.453465:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756181.453479:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222602880:0@lo:400:kworker.0 00000100:00100000:0.0:1782756181.453500:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756181.453529:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222602496 00000100:00100000:2.0:1782756181.453534:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222602880 00000100:00100000:0.0:1782756181.453536:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222602496 00000100:00100000:2.0:1782756181.453537:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222602880 00000100:00100000:1.0:1782756181.453570:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222602624:0@lo:400:kworker.0 00000100:00100000:0.0:1782756181.453584:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222602752 00000100:00100000:0.0:1782756181.453586:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222602752 00000100:00100000:1.0:1782756181.453596:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756181.453631:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222602112 00000100:00100000:1.0:1782756181.453635:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222602112 00000100:00100000:1.0:1782756181.453662:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782756181.453671:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1869355222602112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782756181.453706:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782756181.453757:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1869355222602112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756181.453763:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782756181.453787:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222602624 00000100:00100000:1.0:1782756181.453790:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222602624 00010000:00010000:3.0:1782756181.454120:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782756181.456039:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782756181.456051:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4b606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222602880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756181.456153:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4b606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222602880:12345-0@lo:400:kworker.0 Request processed in 104us (2651us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756181.456160:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1782756181.456215:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c4b607b80 x1869355222602880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782756181.456232:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222602880:0@lo:400:kworker.0 00000100:00100000:2.0:1782756181.457177:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222602368 00000100:00100000:2.0:1782756181.457186:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222602368 00000100:00100000:2.0:1782756181.457220:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782756181.457229:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4b604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222602496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756181.457455:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4b604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222602496:12345-0@lo:400:kworker.0 Request processed in 226us (4174us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756181.457462:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782756181.457478:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782756181.457484:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4b604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869355222602368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756181.457515:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4b604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869355222602368:12345-0@lo:400:kworker.0 Request processed in 32us (4049us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756181.457530:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1782756181.457546:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782756181.457551:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782756181.457555:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782756181.457569:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222602240 00000100:00100000:2.0:1782756181.457585:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222602240 00000100:00100000:2.0:1782756181.457608:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1782756181.457614:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3316:x1869355222602240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756181.457644:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3316:x1869355222602240:12345-0@lo:400:kworker.0 Request processed in 30us (4263us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756181.457650:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1782756181.457690:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869355222602368:0@lo:400:kworker.0 00000100:00100000:2.0:1782756181.457700:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222602240:0@lo:400:kworker.0 00000100:00100000:3.0:1782756181.457825:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222602496:0@lo:400:kworker.0 00000100:00100000:1.0:1782756181.458799:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782756181.458808:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222602624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756181.458887:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222602624:12345-0@lo:400:kworker.0 Request processed in 71us (5279us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756181.458896:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1782756181.458940:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c80fcfb80 x1869355222602112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756181.458957:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222602112:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1782756181.458969:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c809f5500 x1869355222602624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756181.458977:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222602624:0@lo:400:kworker.0 00000100:00100000:0.0:1782756181.463687:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782756181.463702:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4b605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869355222602752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756181.463822:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4b605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869355222602752:12345-0@lo:400:kworker.0 Request processed in 125us (10398us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756181.463954:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869355222602752:0@lo:400:kworker.0 00000100:00100000:0.0:1782756181.464040:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1782756182.476573:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756183.502920:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756184.526575:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756184.879675:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756184.879732:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756184.879846:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209990272 00000100:00100000:1.0:1782756184.879856:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209990272 00000100:00100000:1.0:1782756184.880030:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 196 00000100:00100000:1.0:1782756184.880041:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:2357:x1869355209990272:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1782756184.880220:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:2357:x1869355209990272:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 180us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756184.880228:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 196 00000100:00100000:2.0:1782756184.880312:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209990400 00000100:00100000:2.0:1782756184.880323:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209990400 00000100:00100000:2.0:1782756184.880384:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 41 00000100:00100000:2.0:1782756184.880393:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4b605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+6:2357:x1869355209990400:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:2.0:1782756184.880428:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4b605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+6:2357:x1869355209990400:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 36us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756184.880434:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 41 00000100:00080000:0.0:1782756184.880497:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782756185.043907:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222603008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782756185.043978:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756185.047360:0:8071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222603008 00000100:00100000:2.0:1782756185.047374:0:8071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222603008 00000100:00100000:2.0:1782756185.047442:0:8071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782756185.047469:0:8071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c50164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222603008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782756185.047514:0:8071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1782756185.047529:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782756185.047610:0:8071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c50164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222603008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (3631us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756185.047618:0:8071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1782756185.048013:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c76fd2300 x1869355222603008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756185.048042:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222603008:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782756185.548201:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756186.572260:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0daec403-69b6-4c98-a0ea-f519ca0a480f:3315:1869355222603136:0@lo:400:kworker.0 00000100:00100000:0.0:1782756186.572332:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756186.572382:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c77001180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869355222603648:0@lo:400:kworker.0 00000100:00100000:0.0:1782756186.572410:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756186.572432:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222603648 00000100:00100000:2.0:1782756186.572440:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222603648 00000100:00100000:2.0:1782756186.572498:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782756186.572507:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869355222603648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756186.572557:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869355222603648:12345-0@lo:400:kworker.0 Request processed in 52us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756186.572566:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1782756186.572586:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782756186.572731:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756186.573731:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c77001180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869355222603648:0@lo:400:kworker.0 00000100:00100000:0.0:1782756186.573754:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782756186.573761:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c77002300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222603520:0@lo:400:kworker.0 00000100:00100000:0.0:1782756186.573807:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756186.573852:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869355222603264:0@lo:400:kworker.0 00000100:00100000:0.0:1782756186.573889:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756186.573917:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c77002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222603776:0@lo:400:kworker.0 00000100:00100000:0.0:1782756186.573939:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756186.573959:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782756186.573966:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869355222603392:0@lo:400:kworker.0 00000100:00100000:0.0:1782756186.573986:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756186.573999:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222603520 00000100:00100000:2.0:1782756186.574006:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222603520 00000100:00100000:0.0:1782756186.574014:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222603136 00000100:00100000:0.0:1782756186.574017:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222603136 00000100:00100000:2.0:1782756186.574038:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222603776 00000100:00100000:2.0:1782756186.574041:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222603776 00000100:00100000:0.0:1782756186.574042:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1782756186.574049:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3315:x1869355222603136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756186.574066:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782756186.574072:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77001180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222603520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756186.574126:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3315:x1869355222603136:12345-0@lo:400:kworker.0 Request processed in 76us (1794us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756186.574134:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1782756186.574140:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77001180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222603520:12345-0@lo:400:kworker.0 Request processed in 69us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756186.574146:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782756186.574158:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782756186.574164:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222603264 00000100:00100000:2.0:1782756186.574165:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77000000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222603776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756186.574167:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222603264 00000100:00100000:0.0:1782756186.574192:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222603392 00000100:00100000:0.0:1782756186.574196:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222603392 00000100:00100000:2.0:1782756186.574197:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77000000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222603776:12345-0@lo:400:kworker.0 Request processed in 33us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756186.574204:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782756186.574213:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782756186.574220:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77002680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869355222603264:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1782756186.574234:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782756186.574237:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782756186.574263:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77002680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869355222603264:12345-0@lo:400:kworker.0 Request processed in 43us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756186.574270:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782756186.574282:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1782756186.574289:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869355222603392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756186.574319:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869355222603392:12345-0@lo:400:kworker.0 Request processed in 32us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756186.574325:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1782756186.574414:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869355222603392:0@lo:400:kworker.0 00000100:00100000:0.0:1782756186.574424:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869355222603264:0@lo:400:kworker.0 00010000:00080000:0.0:1782756186.574435:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c77002d80 x1869355222603776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756186.574445:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c77002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222603776:0@lo:400:kworker.0 00000100:00100000:2.0:1782756186.574456:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c77000700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222603904:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1782756186.574473:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c77002300 x1869355222603520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756186.574482:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c77002300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222603520:0@lo:400:kworker.0 00000100:00100000:2.0:1782756186.574485:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756186.574491:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0daec403-69b6-4c98-a0ea-f519ca0a480f:3315:1869355222603136:0@lo:400:kworker.0 00000100:00100000:2.0:1782756186.574514:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222603904 00000100:00100000:2.0:1782756186.574518:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222603904 00000100:00100000:2.0:1782756186.574569:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782756186.574576:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c50165500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222603904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782756186.574604:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782756186.574642:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c50165500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222603904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756186.574647:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1782756186.574672:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c77000700 x1869355222603904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756202 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782756186.574686:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c77000700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222603904:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782756187.598278:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756188.620272:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756189.646953:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756189.996728:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756189.996778:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756189.996816:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209990656 00000100:00100000:0.0:1782756189.996828:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209990656 00000100:00100000:0.0:1782756189.996893:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 45 00000100:00100000:0.0:1782756189.996906:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77002300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+6:2357:x1869355209990656:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756189.996994:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77002300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+6:2357:x1869355209990656:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 92us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756189.997015:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 45 00000100:00100000:1.0:1782756189.997264:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209990528 00000100:00100000:1.0:1782756189.997269:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209990528 00000100:00100000:1.0:1782756189.997300:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 198 00000100:00100000:1.0:1782756189.997307:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:2357:x1869355209990528:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1782756189.997345:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:2357:x1869355209990528:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 39us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756189.997352:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 198 00000100:00080000:2.0:1782756189.999158:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782756190.157117:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782756190.157144:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222604032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782756190.157247:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756190.157376:0:8071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222604032 00000100:00100000:1.0:1782756190.157385:0:8071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222604032 00000100:00100000:1.0:1782756190.157463:0:8071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782756190.157474:0:8071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c50164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222604032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782756190.157513:0:8071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782756190.157576:0:8071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c50164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222604032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756190.157584:0:8071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1782756190.157662:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c76fd1180 x1869355222604032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756206 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756190.157681:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222604032:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782756190.157745:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1782756190.620521:0:9976:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 14:03:08 (1782756188) === 00010000:00010000:3.0:1782756190.668768:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782756191.088420:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756191.089108:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209990784 00000100:00100000:0.0:1782756191.089121:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209990784 00000100:00100000:0.0:1782756191.089258:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 199 00000100:00100000:0.0:1782756191.089271:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:8101:x1869355209990784:12345-192.168.204.25@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782756191.089290:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756191.089307:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4b81a800/0x5e4fb0a8aa198c7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdde5 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756191.089335:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4b81a800/0x5e4fb0a8aa198c7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdde5 expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756191.089346:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4b81a800/0x5e4fb0a8aa198c7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdde5 expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756191.089355:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81a800, rc 0) 00000100:00100000:0.0:1782756191.089419:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+11:8101:x1869355209990784:12345-192.168.204.25@tcp:101:mount.lustre.0 Request processed in 151us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756191.089427:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 199 00000100:00100000:0.0:1782756191.098831:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756191.099058:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209990912 00000100:00100000:1.0:1782756191.099070:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209990912 00000100:00100000:1.0:1782756191.099220:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 200 00000100:00100000:1.0:1782756191.099984:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+11:8101:x1869355209990912:12345-192.168.204.25@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782756191.100408:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+11:8101:x1869355209990912:12345-192.168.204.25@tcp:501:mount.lustre.0 Request processed in 1176us (1588us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756191.100417:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 200 00000100:00100000:2.0:1782756191.108535:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756191.110937:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209991040 00000100:00100000:0.0:1782756191.110970:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209991040 00000100:00100000:0.0:1782756191.111050:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 201 00000100:00100000:0.0:1782756191.111062:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+11:8101:x1869355209991040:12345-192.168.204.25@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782756191.111436:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+11:8101:x1869355209991040:12345-192.168.204.25@tcp:503:mount.lustre.0 Request processed in 375us (2910us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756191.111446:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 201 00000100:00100000:3.0:1782756191.124126:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756191.124225:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209991168 00000100:00100000:1.0:1782756191.124244:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209991168 00000100:00100000:1.0:1782756191.124319:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 202 00000100:00100000:1.0:1782756191.124331:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+11:8105:x1869355209991168:12345-192.168.204.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782756191.125794:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+11:8105:x1869355209991168:12345-192.168.204.25@tcp:502:llog_process_th.0 Request processed in 1456us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756191.125823:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 202 00000100:00100000:2.0:1782756191.145017:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756191.145114:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209991296 00000100:00100000:1.0:1782756191.145124:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209991296 00000100:00100000:1.0:1782756191.145183:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 203 00000100:00100000:1.0:1782756191.145195:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+11:8105:x1869355209991296:12345-192.168.204.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782756191.145842:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+11:8105:x1869355209991296:12345-192.168.204.25@tcp:502:llog_process_th.0 Request processed in 646us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756191.145851:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 203 00000100:00100000:2.0:1782756191.166065:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756191.166222:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209991424 00000100:00100000:1.0:1782756191.166234:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209991424 00000100:00100000:1.0:1782756191.166303:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 204 00000100:00100000:1.0:1782756191.166314:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+11:8101:x1869355209991424:12345-192.168.204.25@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782756191.166336:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756191.166354:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c41496c00/0x5e4fb0a8aa198c85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cde0f expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756191.166389:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c41496c00/0x5e4fb0a8aa198c85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde0f expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756191.166401:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c41496c00/0x5e4fb0a8aa198c85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde0f expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756191.166411:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41496c00, rc 0) 00000100:00100000:1.0:1782756191.166477:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+12:8101:x1869355209991424:12345-192.168.204.25@tcp:101:mount.lustre.0 Request processed in 163us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756191.166484:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 204 00000100:00100000:3.0:1782756191.181258:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756191.182055:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209991552 00000100:00100000:1.0:1782756191.182065:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209991552 00000100:00100000:1.0:1782756191.186177:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 205 00000100:00100000:1.0:1782756191.186278:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+12:8101:x1869355209991552:12345-192.168.204.25@tcp:256:mount.lustre.0 20000000:01000000:1.0:1782756191.186315:0:5798:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1782756191.186346:0:5798:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1782756191.186351:0:5798:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1782756191.186354:0:5798:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1782756191.186357:0:5798:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1782756191.189016:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+12:8101:x1869355209991552:12345-192.168.204.25@tcp:256:mount.lustre.0 Request processed in 2810us (7758us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756191.189033:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 205 00000100:00100000:2.0:1782756191.193570:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756191.193750:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209991680 00000100:00100000:0.0:1782756191.193763:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209991680 00000100:00100000:0.0:1782756191.193834:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 206 00000100:00100000:0.0:1782756191.193846:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+12:8101:x1869355209991680:12345-192.168.204.25@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782756191.193867:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756191.193886:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4b81a000/0x5e4fb0a8aa198c8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cde16 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756191.193924:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4b81a000/0x5e4fb0a8aa198c8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde16 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756191.193937:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4b81a000/0x5e4fb0a8aa198c8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde16 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756191.193948:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81a000, rc 0) 00000100:00100000:0.0:1782756191.194016:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:8101:x1869355209991680:12345-192.168.204.25@tcp:101:mount.lustre.0 Request processed in 171us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756191.194023:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 206 00000100:00100000:3.0:1782756191.199850:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756191.200899:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209991808 00000100:00100000:1.0:1782756191.200913:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209991808 00000100:00100000:1.0:1782756191.200978:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 207 00000100:00100000:1.0:1782756191.200989:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:8101:x1869355209991808:12345-192.168.204.25@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782756191.202430:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:8101:x1869355209991808:12345-192.168.204.25@tcp:501:mount.lustre.0 Request processed in 1423us (2574us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756191.202442:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 207 00000100:00100000:2.0:1782756191.208785:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756191.208875:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209991936 00000100:00100000:0.0:1782756191.208885:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209991936 00000100:00100000:0.0:1782756191.208951:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 208 00000100:00100000:0.0:1782756191.208962:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:8101:x1869355209991936:12345-192.168.204.25@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782756191.209341:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:8101:x1869355209991936:12345-192.168.204.25@tcp:503:mount.lustre.0 Request processed in 379us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756191.209350:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 208 00000100:00100000:2.0:1782756191.216141:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756191.216254:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209992064 00000100:00100000:1.0:1782756191.216268:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209992064 00000100:00100000:1.0:1782756191.216352:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 209 00000100:00100000:1.0:1782756191.216364:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:8110:x1869355209992064:12345-192.168.204.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782756191.216917:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:8110:x1869355209992064:12345-192.168.204.25@tcp:502:llog_process_th.0 Request processed in 551us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756191.216934:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 209 00000100:00100000:3.0:1782756191.219705:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756191.219774:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209992192 00000100:00100000:0.0:1782756191.219785:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209992192 00000100:00100000:0.0:1782756191.219855:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 210 00000100:00100000:0.0:1782756191.219867:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:8110:x1869355209992192:12345-192.168.204.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782756191.220165:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:8110:x1869355209992192:12345-192.168.204.25@tcp:502:llog_process_th.0 Request processed in 299us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756191.220174:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 210 00000100:00100000:2.0:1782756191.231783:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756191.231831:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756191.231877:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209992320 00000100:00100000:0.0:1782756191.231891:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209992320 00000100:00100000:0.0:1782756191.231937:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209992704 00000100:00100000:0.0:1782756191.231940:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209992704 00000100:00100000:3.0:1782756191.231977:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 10 00000100:00100000:0.0:1782756191.231997:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 46 00000100:00100000:3.0:1782756191.231999:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c50165880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2354:x1869355209992320:12345-192.168.204.25@tcp:38:mount.lustre.0 00000100:00100000:0.0:1782756191.232005:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c50167b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+6:2357:x1869355209992704:12345-192.168.204.25@tcp:400:kworker.0 00010000:00080000:3.0:1782756191.232036:0:6579:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 7b9f710d-49d5-44e3-9f56-6807ec02dbcd@192.168.204.25@tcp t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:3.0:1782756191.232101:0:6579:0:(genops.c:1406:class_connect()) connect: client 7b9f710d-49d5-44e3-9f56-6807ec02dbcd, cookie 0x5e4fb0a8aa198c93 00000100:00100000:0.0:1782756191.232121:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c50167b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+6:2357:x1869355209992704:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 117us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756191.232127:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 46 00000004:00100000:3.0:1782756191.232134:0:6579:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1782756191.232721:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782756191.232949:0:6579:0:(import.c:65:import_set_state_nolock()) ffff9d3c7fb15000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782756191.233003:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c50165880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+6:2354:x1869355209992320:12345-192.168.204.25@tcp:38:mount.lustre.0 Request processed in 1014us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756191.233013:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 10 00000100:00100000:2.0:1782756191.237375:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756191.237425:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756191.239215:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209992448 00000100:00100000:1.0:1782756191.239230:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209992448 00000100:00100000:1.0:1782756191.239333:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209992576 00000100:00100000:1.0:1782756191.239337:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209992576 00000100:00100000:1.0:1782756191.239367:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 11 00000100:00100000:1.0:1782756191.239378:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c50164a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+7:0:x1869355209992448:12345-192.168.204.25@tcp:41:mount.lustre.0 00000004:00000024:1.0:1782756191.239445:0:5805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1782756191.239550:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c50164a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+7:0:x1869355209992448:12345-192.168.204.25@tcp:41:mount.lustre.0 Request processed in 172us (2185us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756191.239558:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 11 00000100:00100000:1.0:1782756191.239578:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 12 00000100:00100000:1.0:1782756191.239585:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c50165c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+6:8101:x1869355209992576:12345-192.168.204.25@tcp:41:mount.lustre.0 00000004:00000024:1.0:1782756191.239597:0:5805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1782756191.239622:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c50165c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+6:8101:x1869355209992576:12345-192.168.204.25@tcp:41:mount.lustre.0 Request processed in 38us (2196us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756191.239629:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 12 00000100:00080000:2.0:1782756191.240031:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782756191.254279:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756191.254419:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209992832 00000100:00100000:1.0:1782756191.254429:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209992832 00000100:00100000:1.0:1782756191.254493:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13 00000100:00100000:1.0:1782756191.254504:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c50167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+6:8101:x1869355209992832:12345-192.168.204.25@tcp:40:mount.lustre.0 00000100:00100000:1.0:1782756191.254602:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c50167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+6:8101:x1869355209992832:12345-192.168.204.25@tcp:40:mount.lustre.0 Request processed in 100us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756191.254610:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13 00000100:00100000:0.0:1782756191.263240:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756191.263433:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209993216 00000100:00100000:1.0:1782756191.263444:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209993216 00000100:00100000:1.0:1782756191.263518:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1 00000100:00100000:1.0:1782756191.263545:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+6:8101:x1869355209993216:12345-192.168.204.25@tcp:33:mount.lustre.0 00000004:00200000:1.0:1782756191.263946:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1782756191.264402:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+6:8101:x1869355209993216:12345-192.168.204.25@tcp:33:mount.lustre.0 Request processed in 856us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756191.264412:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1 00000100:00100000:0.0:1782756191.267787:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756191.267854:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756191.268124:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209992960 00000100:00100000:1.0:1782756191.268134:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209992960 00000100:00100000:1.0:1782756191.268170:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209993088 00000100:00100000:1.0:1782756191.268173:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209993088 00000100:00100000:1.0:1782756191.268188:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 12 00000100:00100000:1.0:1782756191.268196:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77001880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1869355209992960:12345-192.168.204.25@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782756191.268232:0:6603:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 7b9f710d-49d5-44e3-9f56-6807ec02dbcd@192.168.204.25@tcp t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:1.0:1782756191.268269:0:6603:0:(genops.c:1406:class_connect()) connect: client 7b9f710d-49d5-44e3-9f56-6807ec02dbcd, cookie 0x5e4fb0a8aa198c9a 00002000:00100000:1.0:1782756191.268282:0:6603:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7b9f710d-49d5-44e3-9f56-6807ec02dbcd/ffff9d3c7fa71000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782756191.268294:0:6603:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782756191.268565:0:6603:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782756191.268599:0:6603:0:(import.c:65:import_set_state_nolock()) ffff9d3c7fa70800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782756191.268697:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77001880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+6:2354:x1869355209992960:12345-192.168.204.25@tcp:8:mount.lustre.0 Request processed in 490us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756191.268706:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 12 00000100:00100000:1.0:1782756191.268727:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13 00000100:00100000:1.0:1782756191.268732:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77003b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1869355209993088:12345-192.168.204.25@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782756191.268749:0:6603:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 7b9f710d-49d5-44e3-9f56-6807ec02dbcd@192.168.204.25@tcp t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:1.0:1782756191.268766:0:6603:0:(genops.c:1406:class_connect()) connect: client 7b9f710d-49d5-44e3-9f56-6807ec02dbcd, cookie 0x5e4fb0a8aa198ca1 00002000:00100000:1.0:1782756191.268771:0:6603:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7b9f710d-49d5-44e3-9f56-6807ec02dbcd/ffff9d3c7fa77800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782756191.268797:0:6603:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782756191.268919:0:6603:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782756191.268935:0:6603:0:(import.c:65:import_set_state_nolock()) ffff9d3c7fa74000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782756191.268981:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77003b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+6:2354:x1869355209993088:12345-192.168.204.25@tcp:8:mount.lustre.0 Request processed in 246us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756191.268988:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13 00000100:00100000:0.0:1782756191.692300:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782756191.692328:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c77000a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222604160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782756191.692404:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756191.692571:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222604160 00000100:00100000:2.0:1782756191.692581:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222604160 00000100:00100000:2.0:1782756191.692649:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782756191.692659:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77003480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222604160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782756191.692693:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782756191.692746:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77003480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222604160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756191.692754:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782756191.693032:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76fd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869355222604416:0@lo:400:kworker.0 00000100:00100000:2.0:1782756191.693071:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756191.693115:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782756191.693121:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76fd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222604288:0@lo:400:kworker.0 00000100:00100000:2.0:1782756191.693153:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756191.693174:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869355222604800:0@lo:400:kworker.0 00000100:00100000:2.0:1782756191.693196:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756191.693218:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222604672:0@lo:400:kworker.0 00000100:00100000:2.0:1782756191.693242:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756191.693259:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782756191.693264:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869355222604544:0@lo:400:kworker.0 00000100:00100000:2.0:1782756191.693286:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782756191.693518:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782756191.693565:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c77000a80 x1869355222604160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756191.693599:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c77000a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222604160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782756191.693637:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222604416 00000100:00100000:0.0:1782756191.693642:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222604416 00000100:00100000:0.0:1782756191.693694:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222604800 00000100:00100000:0.0:1782756191.693697:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222604800 00000100:00100000:0.0:1782756191.693718:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222604544 00000100:00100000:0.0:1782756191.693720:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222604544 00000100:00100000:0.0:1782756191.693736:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782756191.693744:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c50167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869355222604416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756191.693794:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c50167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869355222604416:12345-0@lo:400:kworker.0 Request processed in 50us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756191.693800:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782756191.693816:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782756191.693823:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c809f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869355222604800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756191.693852:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c809f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869355222604800:12345-0@lo:400:kworker.0 Request processed in 30us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756191.693858:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782756191.693862:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1782756191.693870:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782756191.693871:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c809f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869355222604544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756191.693887:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869355222604800:0@lo:400:kworker.0 00000100:00100000:0.0:1782756191.693897:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76fd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869355222604416:0@lo:400:kworker.0 00000100:00100000:2.0:1782756191.693905:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c809f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869355222604544:12345-0@lo:400:kworker.0 Request processed in 37us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756191.693911:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782756191.693934:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869355222604544:0@lo:400:kworker.0 00000100:00100000:1.0:1782756191.695477:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222604672 00000100:00100000:1.0:1782756191.695494:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222604672 00000100:00100000:1.0:1782756191.695546:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782756191.695557:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c809f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222604672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756191.695641:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c809f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222604672:12345-0@lo:400:kworker.0 Request processed in 85us (2397us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756191.695648:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782756191.695675:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222604288 00000100:00100000:1.0:1782756191.695688:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222604288 00000100:00100000:1.0:1782756191.695712:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1782756191.695718:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3317:x1869355222604288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756191.695756:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3317:x1869355222604288:12345-0@lo:400:kworker.0 Request processed in 38us (2602us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756191.695762:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00010000:00080000:3.0:1782756191.697313:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c76fd0000 x1869355222604672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756191.697333:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222604672:0@lo:400:kworker.0 00010000:00010000:0.0:1782756191.703471:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756191.703788:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76fd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222604288:0@lo:400:kworker.0 00000001:00100000:1.0:1782756191.755199:0:5825:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7b9f710d-49d5-44e3-9f56-6807ec02dbcd 00000001:00100000:0.0:1782756191.782229:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7b9f710d-49d5-44e3-9f56-6807ec02dbcd 00010000:00010000:0.0:1782756192.716586:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756193.740519:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756194.764562:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782756195.281134:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782756195.281161:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222604928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782756195.281244:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756195.281402:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222604928 00000100:00100000:3.0:1782756195.281411:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222604928 00000100:00100000:3.0:1782756195.281491:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782756195.281500:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c809f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222604928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782756195.281548:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782756195.281594:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c809f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222604928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756195.281617:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1782756195.281862:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c76fd0700 x1869355222604928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756211 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782756195.281886:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222604928:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782756195.282015:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782756195.791610:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782756196.348240:0:6627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7b9f710d-49d5-44e3-9f56-6807ec02dbcd 00000001:02000400:0.0:1782756196.448546:0:10173:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg425-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:1.0:1782756196.656826:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756196.656870:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756196.656892:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756196.656913:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756196.656937:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756196.656973:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209993344 00000100:00100000:1.0:1782756196.656984:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209993344 00000100:00100000:1.0:1782756196.657037:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 212 00000100:00100000:1.0:1782756196.657046:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2357:x1869355209993344:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1782756196.657135:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2357:x1869355209993344:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 89us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756196.657143:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 212 00000100:00100000:1.0:1782756196.657175:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209993856 00000100:00100000:1.0:1782756196.657178:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209993856 00000100:00100000:1.0:1782756196.657209:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209993728 00000100:00100000:1.0:1782756196.657212:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209993728 00000100:00100000:1.0:1782756196.657228:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 26 00000100:00100000:1.0:1782756196.657234:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2357:x1869355209993856:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1782756196.657262:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2357:x1869355209993856:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 28us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756196.657269:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 26 00000100:00100000:1.0:1782756196.657280:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 27 00000100:00100000:1.0:1782756196.657286:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2358:x1869355209993728:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1782756196.657310:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2358:x1869355209993728:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 23us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756196.657316:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 27 00000100:00080000:1.0:1782756196.657659:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782756196.657665:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782756196.657873:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209993472 00000100:00100000:0.0:1782756196.657874:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209993600 00000100:00100000:2.0:1782756196.657879:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209993472 00000100:00100000:0.0:1782756196.657880:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209993600 00000100:00100000:2.0:1782756196.657927:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 50 00000100:00100000:2.0:1782756196.657936:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+6:2358:x1869355209993472:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:2.0:1782756196.657977:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+6:2358:x1869355209993472:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 42us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756196.657983:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 50 00000100:00100000:0.0:1782756196.658874:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 51 00000100:00100000:0.0:1782756196.658887:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2357:x1869355209993600:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756196.658958:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2357:x1869355209993600:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 75us (2064us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756196.658966:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 51 00000100:00080000:1.0:1782756196.660669:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782756196.812930:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756196.813445:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869355222605312:0@lo:400:kworker.0 00000100:00100000:0.0:1782756196.813514:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756196.814111:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0daec403-69b6-4c98-a0ea-f519ca0a480f:3314:1869355222605056:0@lo:400:kworker.0 00000100:00100000:2.0:1782756196.814556:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222605312 00000100:00100000:2.0:1782756196.814563:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222605312 00000100:00100000:2.0:1782756196.814635:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782756196.814644:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869355222605312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782756196.814733:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222605440:0@lo:400:kworker.0 00000100:00100000:1.0:1782756196.814799:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756196.814859:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869355222605568:0@lo:400:kworker.0 00000100:00100000:1.0:1782756196.814885:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756196.814909:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782756196.814916:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869355222605184:0@lo:400:kworker.0 00000100:00100000:1.0:1782756196.814940:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756196.814957:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222605696:0@lo:400:kworker.0 00000100:00100000:1.0:1782756196.814990:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756196.815017:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222605056 00000100:00100000:1.0:1782756196.815020:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222605056 00000100:00100000:1.0:1782756196.815045:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1782756196.815051:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3314:x1869355222605056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756196.815120:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3314:x1869355222605056:12345-0@lo:400:kworker.0 Request processed in 68us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756196.815127:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1782756196.815157:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222605568 00000100:00100000:1.0:1782756196.815160:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222605568 00000100:00100000:1.0:1782756196.815178:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222605184 00000100:00100000:1.0:1782756196.815180:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222605184 00000100:00100000:1.0:1782756196.815193:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782756196.815199:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869355222605568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756196.815227:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869355222605568:12345-0@lo:400:kworker.0 Request processed in 29us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756196.815234:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782756196.815244:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782756196.815249:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869355222605184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756196.815271:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869355222605184:12345-0@lo:400:kworker.0 Request processed in 22us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756196.815286:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782756196.815306:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222605696 00000100:00100000:2.0:1782756196.815425:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869355222605312:12345-0@lo:400:kworker.0 Request processed in 780us (1910us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756196.815431:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1782756196.815451:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782756196.815604:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222605696 00000100:00100000:1.0:1782756196.815647:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782756196.815653:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222605696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756196.815759:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222605696:12345-0@lo:400:kworker.0 Request processed in 106us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756196.815766:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782756196.815806:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869355222605184:0@lo:400:kworker.0 00010000:00080000:1.0:1782756196.815820:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c7fb74000 x1869355222605696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756196.815830:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222605696:0@lo:400:kworker.0 00000100:00100000:1.0:1782756196.815840:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0daec403-69b6-4c98-a0ea-f519ca0a480f:3314:1869355222605056:0@lo:400:kworker.0 00000100:00100000:1.0:1782756196.815849:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869355222605568:0@lo:400:kworker.0 00000100:00080000:2.0:1782756196.815925:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782756196.816617:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869355222605312:0@lo:400:kworker.0 00000100:00100000:0.0:1782756196.816630:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c77000a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222605824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782756196.816666:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756196.816728:0:8071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222605824 00000100:00100000:0.0:1782756196.816733:0:8071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222605824 00000100:00100000:3.0:1782756196.816754:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756196.816771:0:8071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782756196.816780:0:8071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77003800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222605824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782756196.816825:0:8071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782756196.816864:0:8071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77003800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222605824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756196.816871:0:8071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782756196.816882:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222605440 00000100:00100000:2.0:1782756196.816887:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222605440 00010000:00080000:0.0:1782756196.816910:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c77000a80 x1869355222605824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782756196.816920:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782756196.816930:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222605440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756196.816932:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c77000a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222605824:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1782756196.816998:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c7fb74380 x1869355222605440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756196.817008:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222605440:0@lo:400:kworker.0 00000100:00100000:2.0:1782756196.818126:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222605440:12345-0@lo:400:kworker.0 Request processed in 51us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756196.818138:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1782756197.836298:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756198.860554:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756199.886154:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756200.402180:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222605952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782756200.402289:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756200.402525:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222605952 00000100:00100000:3.0:1782756200.402535:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222605952 00000100:00080000:2.0:1782756200.402595:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782756200.402627:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782756200.402640:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222605952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782756200.402692:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782756200.402756:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222605952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756200.402765:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1782756200.402913:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c76fd2300 x1869355222605952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756216 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756200.402937:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222605952:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782756200.909281:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782756201.771000:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756201.771059:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756201.771148:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756201.771179:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756201.771216:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756201.771248:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209994240 00000100:00100000:3.0:1782756201.771260:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209994240 00000100:00100000:3.0:1782756201.771331:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209994112 00000100:00100000:3.0:1782756201.771335:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209994112 00000100:00100000:3.0:1782756201.771371:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 55 00000100:00100000:3.0:1782756201.771384:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2358:x1869355209994240:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756201.771495:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2358:x1869355209994240:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 103us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756201.771505:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 55 00000100:00100000:3.0:1782756201.771529:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 56 00000100:00100000:3.0:1782756201.771537:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+6:2358:x1869355209994112:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756201.771569:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+6:2358:x1869355209994112:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 33us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756201.771576:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 56 00000100:00100000:3.0:1782756201.771597:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209994496 00000100:00100000:3.0:1782756201.771601:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209994496 00000100:00100000:3.0:1782756201.771627:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209994368 00000100:00100000:3.0:1782756201.771630:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209994368 00000100:00100000:1.0:1782756201.771648:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 30 00000100:00100000:1.0:1782756201.771661:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ef2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2358:x1869355209994496:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756201.771700:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209993984 00000100:00100000:1.0:1782756201.771701:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ef2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2358:x1869355209994496:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 43us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756201.771706:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209993984 00000100:00100000:0.0:1782756201.771751:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 214 00000100:00100000:0.0:1782756201.771760:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2358:x1869355209993984:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756201.771790:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2358:x1869355209993984:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 31us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756201.771797:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 214 00000100:00100000:3.0:1782756201.771862:0:6605:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1782756201.771872:0:6605:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1782756201.772107:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 31 00000100:00100000:3.0:1782756201.772817:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2358:x1869355209994368:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756201.772896:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2358:x1869355209994368:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 780us (1678us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756201.772907:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 31 00000100:00080000:3.0:1782756201.772967:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782756201.772973:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782756201.772979:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782756201.773399:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 30 00010000:00010000:0.0:1782756201.934608:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756201.934840:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c77000a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222606080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782756201.935097:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0daec403-69b6-4c98-a0ea-f519ca0a480f:3315:1869355222606208:0@lo:400:kworker.0 00000100:00100000:2.0:1782756201.935165:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756201.935211:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869355222606720:0@lo:400:kworker.0 00000100:00100000:2.0:1782756201.935238:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756201.935265:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782756201.935272:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222606592:0@lo:400:kworker.0 00000100:00100000:2.0:1782756201.935299:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756201.935332:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869355222606464:0@lo:400:kworker.0 00000100:00100000:2.0:1782756201.935355:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756201.935379:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782756201.935385:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869355222606336:0@lo:400:kworker.0 00000100:00100000:2.0:1782756201.935409:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756201.935430:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222606848:0@lo:400:kworker.0 00000100:00100000:2.0:1782756201.935452:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756201.935491:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222606720 00000100:00100000:2.0:1782756201.935498:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222606720 00000100:00100000:2.0:1782756201.935553:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222606464 00000100:00100000:2.0:1782756201.935556:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222606464 00000100:00100000:2.0:1782756201.935577:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222606336 00000100:00100000:2.0:1782756201.935579:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222606336 00000100:00100000:2.0:1782756201.935593:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782756201.935601:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869355222606720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756201.935677:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869355222606720:12345-0@lo:400:kworker.0 Request processed in 75us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756201.935687:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782756201.935710:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782756201.935717:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869355222606464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756201.935743:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222606208 00000100:00100000:0.0:1782756201.935749:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222606208 00000100:00100000:2.0:1782756201.935751:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869355222606464:12345-0@lo:400:kworker.0 Request processed in 34us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756201.935759:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782756201.935772:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782756201.935780:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869355222606336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756201.935811:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869355222606336:12345-0@lo:400:kworker.0 Request processed in 33us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756201.935817:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782756201.935838:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222606592 00000100:00100000:2.0:1782756201.935842:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222606592 00000100:00100000:0.0:1782756201.935859:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1782756201.935871:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3315:x1869355222606208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756201.935873:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222606848 00000100:00100000:2.0:1782756201.935877:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222606848 00000100:00100000:1.0:1782756201.936202:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756201.936285:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222606080 00000100:00100000:1.0:1782756201.936290:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222606080 00000100:00100000:1.0:1782756201.936323:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782756201.936330:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222606080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782756201.936360:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782756201.936397:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222606080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756201.936404:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1782756201.936445:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c77000a80 x1869355222606080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756201.936466:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c77000a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222606080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782756201.936905:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3315:x1869355222606208:12345-0@lo:400:kworker.0 Request processed in 1037us (1739us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756201.936913:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1782756201.937283:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782756201.937292:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222606592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756201.937333:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222606592:12345-0@lo:400:kworker.0 Request processed in 43us (2034us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756201.937352:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782756201.937366:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782756201.937373:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222606848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756201.937404:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222606848:12345-0@lo:400:kworker.0 Request processed in 31us (1952us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756201.937421:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1782756201.937455:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782756201.937461:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782756201.937508:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c7fb77b80 x1869355222606592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782756201.937520:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222606592:0@lo:400:kworker.0 00000100:00100000:2.0:1782756201.937533:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0daec403-69b6-4c98-a0ea-f519ca0a480f:3315:1869355222606208:0@lo:400:kworker.0 00000100:00100000:2.0:1782756201.937546:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869355222606720:0@lo:400:kworker.0 00000100:00100000:2.0:1782756201.937584:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869355222606336:0@lo:400:kworker.0 00010000:00080000:2.0:1782756201.937595:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c7fb77480 x1869355222606848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782756201.937604:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222606848:0@lo:400:kworker.0 00000100:00100000:2.0:1782756201.937614:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869355222606464:0@lo:400:kworker.0 00010000:00010000:2.0:1782756202.956335:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756203.980332:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756205.004616:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756205.516634:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782756205.516662:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222606976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782756205.516741:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756205.516888:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222606976 00000100:00100000:3.0:1782756205.516897:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222606976 00000100:00100000:3.0:1782756205.516971:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782756205.516983:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c809f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222606976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782756205.517020:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782756205.517072:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c809f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222606976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756205.517110:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1782756205.517162:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c7fb75880 x1869355222606976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756221 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756205.517182:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222606976:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782756205.517249:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782756206.029068:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756206.889975:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756206.890028:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756206.890104:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756206.890134:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756206.890172:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209995008 00000100:00100000:0.0:1782756206.890182:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756206.890188:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209995008 00000100:00100000:0.0:1782756206.890226:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209994624 00000100:00100000:0.0:1782756206.890236:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209994624 00000100:00100000:0.0:1782756206.890295:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 216 00000100:00100000:0.0:1782756206.890306:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2355:x1869355209994624:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756206.890390:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209995136 00000100:00100000:3.0:1782756206.890397:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209995136 00000100:00100000:0.0:1782756206.890415:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2355:x1869355209994624:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 108us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756206.890428:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 216 00000100:00100000:3.0:1782756206.890441:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 34 00000100:00100000:3.0:1782756206.890452:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2355:x1869355209995008:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756206.890477:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209994752 00000100:00100000:0.0:1782756206.890484:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209994752 00000100:00100000:0.0:1782756206.890533:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209994880 00000100:00100000:3.0:1782756206.890535:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2355:x1869355209995008:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 80us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756206.890539:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209994880 00000100:00100000:3.0:1782756206.890548:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 34 00000100:00100000:0.0:1782756206.890573:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 60 00000100:00100000:0.0:1782756206.890589:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+6:2355:x1869355209994752:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756206.890599:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 35 00000100:00100000:3.0:1782756206.890613:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77000e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2355:x1869355209995136:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756206.890645:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+6:2355:x1869355209994752:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 61us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756206.890655:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 60 00000100:00100000:3.0:1782756206.890662:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77000e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2355:x1869355209995136:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 51us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756206.890693:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 61 00000100:00100000:3.0:1782756206.890694:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 35 00000100:00080000:3.0:1782756206.890720:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782756206.890726:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782756206.890728:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782756206.890849:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77002a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2355:x1869355209994880:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756206.890888:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77002a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2355:x1869355209994880:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 44us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756206.891601:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 61 00010000:00010000:1.0:1782756207.052490:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756207.052579:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222607104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782756207.052642:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756207.052710:0:8071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222607104 00000100:00100000:1.0:1782756207.052717:0:8071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222607104 00000100:00100000:1.0:1782756207.052765:0:8071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782756207.052773:0:8071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222607104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782756207.052805:0:8071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782756207.052852:0:8071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222607104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756207.052859:0:8071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1782756207.052878:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782756207.052920:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c80fcfb80 x1869355222607104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756207.052937:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222607104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782756207.053648:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222607616:0@lo:400:kworker.0 00000100:00100000:1.0:1782756207.053686:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756207.053708:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782756207.053714:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0daec403-69b6-4c98-a0ea-f519ca0a480f:3314:1869355222607232:0@lo:400:kworker.0 00000100:00100000:1.0:1782756207.053743:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756207.053766:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869355222607744:0@lo:400:kworker.0 00000100:00100000:1.0:1782756207.053807:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756207.053833:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869355222607360:0@lo:400:kworker.0 00000100:00100000:1.0:1782756207.053843:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222607232 00000100:00100000:1.0:1782756207.053850:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222607232 00000100:00100000:3.0:1782756207.053873:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756207.053888:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1782756207.053898:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3314:x1869355222607232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782756207.053901:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782756207.053910:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869355222607488:0@lo:400:kworker.0 00000100:00100000:1.0:1782756207.053943:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3314:x1869355222607232:12345-0@lo:400:kworker.0 Request processed in 46us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756207.053951:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1782756207.053956:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756207.053985:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222607744 00000100:00100000:1.0:1782756207.053990:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222607744 00000100:00100000:3.0:1782756207.053993:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222607616 00000100:00100000:3.0:1782756207.054000:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222607616 00000100:00100000:1.0:1782756207.054027:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222607360 00000100:00100000:1.0:1782756207.054032:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222607360 00000100:00100000:3.0:1782756207.054043:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782756207.054049:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222607488 00000100:00100000:3.0:1782756207.054054:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222607616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756207.054055:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222607488 00000100:00100000:3.0:1782756207.054114:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222607616:12345-0@lo:400:kworker.0 Request processed in 64us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756207.054121:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782756207.054162:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1782756207.054290:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782756207.054300:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869355222607360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782756207.054340:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77209180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869355222607744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756207.054345:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869355222607360:12345-0@lo:400:kworker.0 Request processed in 46us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756207.054354:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782756207.054394:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77209180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869355222607744:12345-0@lo:400:kworker.0 Request processed in 224us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756207.054402:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782756207.054443:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869355222607360:0@lo:400:kworker.0 00000100:00100000:0.0:1782756207.055067:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0daec403-69b6-4c98-a0ea-f519ca0a480f:3314:1869355222607232:0@lo:400:kworker.0 00000100:00100000:0.0:1782756207.055106:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869355222607744:0@lo:400:kworker.0 00010000:00080000:0.0:1782756207.055119:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c78fc0000 x1869355222607616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756207.055129:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222607616:0@lo:400:kworker.0 00000100:00080000:0.0:1782756207.055162:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782756207.055167:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782756207.055275:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782756207.055285:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869355222607488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756207.055337:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869355222607488:12345-0@lo:400:kworker.0 Request processed in 54us (1382us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756207.055342:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782756207.056743:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869355222607488:0@lo:400:kworker.0 00010000:00010000:0.0:1782756208.076444:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756209.100628:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756210.125750:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782756210.532245:0:10876:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1782756210.636278:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782756210.636307:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222607872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782756210.636393:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756210.636460:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222607872 00000100:00100000:0.0:1782756210.636471:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222607872 00000100:00080000:1.0:1782756210.636683:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782756210.636991:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782756210.637006:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7720ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222607872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782756210.637043:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782756210.637124:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7720ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222607872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756210.637131:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1782756210.637210:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c78ef0e00 x1869355222607872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756226 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756210.637231:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222607872:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782756211.150736:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782756212.014192:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756212.014246:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756212.014354:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756212.014394:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209995264 00000100:00100000:2.0:1782756212.014406:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209995264 00000100:00100000:2.0:1782756212.014480:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 218 00000100:00100000:2.0:1782756212.014493:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2356:x1869355209995264:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:2.0:1782756212.014599:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2356:x1869355209995264:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 107us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756212.014608:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 218 00000100:00100000:3.0:1782756212.014638:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209995392 00000100:00100000:3.0:1782756212.014646:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209995392 00000100:00100000:2.0:1782756212.014656:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209995520 00000100:00100000:2.0:1782756212.014662:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209995520 00000100:00100000:2.0:1782756212.014704:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 65 00000100:00100000:3.0:1782756212.014712:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 66 00000100:00100000:2.0:1782756212.014714:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2356:x1869355209995520:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756212.014727:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+6:2356:x1869355209995392:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:2.0:1782756212.014757:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2356:x1869355209995520:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 45us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756212.014765:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 65 00000100:00100000:3.0:1782756212.014771:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+6:2356:x1869355209995392:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 47us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756212.014779:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 66 00000100:00080000:1.0:1782756212.015163:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782756212.021278:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756212.021327:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756212.021462:0:10416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209995648 00000100:00100000:3.0:1782756212.021479:0:10416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209995648 00000100:00100000:2.0:1782756212.021490:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209995776 00000100:00100000:2.0:1782756212.021503:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209995776 00000100:00080000:1.0:1782756212.021534:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782756212.021538:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782756212.021592:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14 00000100:00100000:3.0:1782756212.021677:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77000a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2354:x1869355209995648:12345-192.168.204.25@tcp:9:kworker.0 00000020:00000080:3.0:1782756212.021724:0:10416:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa198c9a 00000100:00080000:3.0:1782756212.021736:0:10416:0:(import.c:65:import_set_state_nolock()) ffff9d3c7fa70800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782756212.021786:0:10416:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1782756212.022319:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77000a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+2:2354:x1869355209995648:12345-192.168.204.25@tcp:9:kworker.0 Request processed in 645us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756212.022328:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14 00000100:00100000:2.0:1782756212.023876:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15 00000100:00100000:2.0:1782756212.023895:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77000700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2354:x1869355209995776:12345-192.168.204.25@tcp:9:kworker.0 00000020:00000080:2.0:1782756212.023929:0:6603:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa198ca1 00000100:00080000:2.0:1782756212.023939:0:6603:0:(import.c:65:import_set_state_nolock()) ffff9d3c7fa74000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782756212.024022:0:6603:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1782756212.024634:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77000700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+2:2354:x1869355209995776:12345-192.168.204.25@tcp:9:kworker.0 Request processed in 742us (3302us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756212.024668:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15 00010000:00010000:2.0:1782756212.024722:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756212.024729:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782756212.172523:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222608000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782756212.173500:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869355222608384:0@lo:400:kworker.0 00000100:00100000:2.0:1782756212.173559:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756212.173940:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0daec403-69b6-4c98-a0ea-f519ca0a480f:3314:1869355222608128:0@lo:400:kworker.0 00000100:00100000:1.0:1782756212.173982:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756212.174040:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869355222608640:0@lo:400:kworker.0 00000100:00100000:1.0:1782756212.174211:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222608384 00000100:00100000:1.0:1782756212.174219:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222608384 00000100:00100000:1.0:1782756212.174300:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782756212.174310:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869355222608384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756212.174362:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869355222608384:12345-0@lo:400:kworker.0 Request processed in 54us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756212.174369:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1782756212.174412:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782756212.174656:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222608128 00000100:00100000:0.0:1782756212.174662:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222608128 00000100:00100000:2.0:1782756212.174701:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869355222608384:0@lo:400:kworker.0 00000100:00100000:2.0:1782756212.174725:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782756212.174731:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222608512:0@lo:400:kworker.0 00000100:00100000:0.0:1782756212.174744:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1782756212.174766:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3314:x1869355222608128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756212.175108:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3314:x1869355222608128:12345-0@lo:400:kworker.0 Request processed in 320us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756212.175117:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1782756212.177189:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869355222608256:0@lo:400:kworker.0 00000100:00100000:3.0:1782756212.177259:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756212.177309:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78edbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222608768:0@lo:400:kworker.0 00000100:00100000:3.0:1782756212.177344:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756212.177392:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756212.177458:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222608256 00000100:00100000:1.0:1782756212.177479:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222608256 00000100:00100000:0.0:1782756212.177509:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222608640 00000100:00100000:0.0:1782756212.177514:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222608640 00000100:00100000:0.0:1782756212.177567:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782756212.177577:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782756212.177578:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869355222608256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756212.177585:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869355222608640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756212.177646:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869355222608256:12345-0@lo:400:kworker.0 Request processed in 70us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756212.177655:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782756212.177682:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222608768 00000100:00100000:0.0:1782756212.177685:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222608768 00000100:00100000:0.0:1782756212.177720:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782756212.177731:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222608768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756212.177734:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756212.177744:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869355222608640:12345-0@lo:400:kworker.0 Request processed in 158us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756212.177751:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1782756212.177772:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756212.177778:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222608768:12345-0@lo:400:kworker.0 Request processed in 50us (432us total) trans 0 rc 0/0 00010000:00010000:2.0:1782756212.177789:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756212.177801:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782756212.177815:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222608512 00000100:00100000:0.0:1782756212.177818:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222608512 00000100:00100000:3.0:1782756212.177830:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0daec403-69b6-4c98-a0ea-f519ca0a480f:3314:1869355222608128:0@lo:400:kworker.0 00000100:00100000:0.0:1782756212.177848:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782756212.177849:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869355222608640:0@lo:400:kworker.0 00000100:00100000:0.0:1782756212.177861:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222608512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756212.177910:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222608512:12345-0@lo:400:kworker.0 Request processed in 51us (180us total) trans 0 rc 0/0 00010000:00080000:2.0:1782756212.177926:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c78ed8700 x1869355222608512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756212.177931:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782756212.177943:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222608512:0@lo:400:kworker.0 00000100:00080000:3.0:1782756212.177969:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782756212.177975:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782756212.177979:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782756212.177992:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869355222608256:0@lo:400:kworker.0 00010000:00080000:2.0:1782756212.178006:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c78edbb80 x1869355222608768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782756212.178015:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78edbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222608768:0@lo:400:kworker.0 00000100:00100000:3.0:1782756212.178031:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222608000 00000100:00100000:3.0:1782756212.178037:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222608000 00000100:00100000:3.0:1782756212.178101:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782756212.178111:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222608000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782756212.178157:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782756212.178198:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222608000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756212.178206:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1782756212.178245:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c7fb74a80 x1869355222608000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756212.178262:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222608000:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1782756212.229899:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7b9f710d-49d5-44e3-9f56-6807ec02dbcd 00000020:00000080:2.0:1782756212.229909:0:7503:0:(genops.c:906:class_export_put()) final put ffff9d3c7fa77800/7b9f710d-49d5-44e3-9f56-6807ec02dbcd 00000020:00000080:1.0:1782756212.230047:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c7fa77800/7b9f710d-49d5-44e3-9f56-6807ec02dbcd for lustre-OST0001 00000020:00000080:1.0:1782756212.230133:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d3c7fa74000 for lustre-OST0001 00010000:00010000:2.0:1782756213.201105:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782756213.286411:0:11025:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff3321e3f0 20000000:00000080:0.0:1782756213.286541:0:11025:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d3c76767800 uarg=0000000000000000 20000000:01000000:0.0:1782756213.286580:0:11025:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782756213.286586:0:11025:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782756213.286590:0:11025:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1782756213.287690:0:11026:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1782756213.287910:0:11025:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1782756213.294459:0:11025:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1782756213.294490:0:11025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d3c4b81a600/0x5e4fb0a8aa198ca8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756213.294512:0:11025:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c4b81a400/0x5e4fb0a8aa198c4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cddde expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756213.294521:0:11025:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c4a63dc00/0x5e4fb0a8aa198c5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198c54 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756213.294527:0:11025:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198c69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198c62 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756213.294533:0:11025:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198c77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198c70 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756213.294539:0:11025:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c4b81a000/0x5e4fb0a8aa198c8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde16 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756213.294546:0:11025:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d3c4b81a600/0x5e4fb0a8aa198ca8 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756213.294596:0:11025:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c4b81a000/0x5e4fb0a8aa198c8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde16 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756213.294625:0:11025:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3c4b81a000/0x5e4fb0a8aa198c8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde16 expref: 12 pid: 5796 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756213.294639:0:11025:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ed8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11025:1869355222608896:192.168.204.25@tcp:104: 00010000:00010000:0.0:1782756213.294799:0:11025:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198c77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa198c70 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756213.294807:0:11025:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198c77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198c70 expref: 18 pid: 5798 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756213.294816:0:11025:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78edb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11025:1869355222609024:0@lo:104: 00000100:00100000:0.0:1782756213.294852:0:11025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782756213.294890:0:11025:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198c69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa198c62 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756213.294897:0:11025:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198c69 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198c62 expref: 18 pid: 5797 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756213.294905:0:11025:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78edb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11025:1869355222609152:0@lo:104: 00000100:00100000:0.0:1782756213.294925:0:11025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782756213.294959:0:11025:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c4a63dc00/0x5e4fb0a8aa198c5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa198c54 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756213.294967:0:11025:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d3c4a63dc00/0x5e4fb0a8aa198c5b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198c54 expref: 18 pid: 5797 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756213.294975:0:11025:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ed9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11025:1869355222609280:0@lo:104: 00000100:00100000:0.0:1782756213.294994:0:11025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782756213.295025:0:11025:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c4b81a400/0x5e4fb0a8aa198c4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cddde expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756213.295034:0:11025:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3c4b81a400/0x5e4fb0a8aa198c4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cddde expref: 12 pid: 5798 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756213.295043:0:11025:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ed8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11025:1869355222609408:192.168.204.25@tcp:104: 00000100:00100000:0.0:1782756213.295071:0:11025:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c50115c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782756213.295479:0:8366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222609024 00000100:00100000:2.0:1782756213.295494:0:8366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222609024 00000100:00100000:2.0:1782756213.295533:0:8366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222609152 00000100:00100000:2.0:1782756213.295536:0:8366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222609152 00000100:00100000:2.0:1782756213.295548:0:8366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222609280 00000100:00100000:2.0:1782756213.295550:0:8366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222609280 00000100:00100000:2.0:1782756213.295564:0:8366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782756213.295573:0:8366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78edb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+5:11025:x1869355222609024:12345-0@lo:104: 00010000:00010000:2.0:1782756213.295584:0:8366:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: ffff9d3c41497e00/0x5e4fb0a8aa198c70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198c77 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756213.295651:0:8366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782756213.295658:0:8366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78edb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+5:11025:x1869355222609024:12345-0@lo:104: Request processed in 86us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756213.295664:0:8366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782756213.295680:0:8366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782756213.295687:0:8366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+4:11025:x1869355222609152:12345-0@lo:104: 00010000:00010000:2.0:1782756213.295694:0:8366:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198c62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198c69 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756213.295727:0:8366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782756213.295733:0:8366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+4:11025:x1869355222609152:12345-0@lo:104: Request processed in 48us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756213.295738:0:8366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782756213.295749:0:8366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782756213.295754:0:8366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78edaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+3:11025:x1869355222609280:12345-0@lo:104: 00010000:00010000:2.0:1782756213.295761:0:8366:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d600/0x5e4fb0a8aa198c54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198c5b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756213.295797:0:8366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1782756213.295807:0:8366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78edaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+3:11025:x1869355222609280:12345-0@lo:104: Request processed in 53us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756213.295813:0:8366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1782756213.295830:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782756213.295835:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c41497e00/0x5e4fb0a8aa198c70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198c77 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756213.295842:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41497e00 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:2.0:1782756213.295845:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41497e00/0x5e4fb0a8aa198c70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa198c77 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756213.295855:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c41497e00/0x5e4fb0a8aa198c70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa198c77 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782756213.295861:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41497e00/0x5e4fb0a8aa198c70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa198c77 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782756213.295866:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782756213.295898:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c41497e00/0x5e4fb0a8aa198c70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198c77 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756213.295904:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782756213.295921:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c41497e00/0x5e4fb0a8aa198c70 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198c77 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756213.295927:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c41497e00/0x5e4fb0a8aa198c70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198c77 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756213.295941:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782756213.295944:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198c62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198c69 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756213.295960:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41496600 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:2.0:1782756213.295964:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198c62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa198c69 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756213.295970:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198c62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa198c69 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782756213.295977:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198c62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa198c69 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782756213.295981:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782756213.295992:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198c62 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198c69 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756213.295995:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782756213.296000:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198c62 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198c69 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756213.296004:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198c62 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198c69 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756213.296014:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782756213.296016:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d600/0x5e4fb0a8aa198c54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198c5b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756213.296019:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168d600 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:2.0:1782756213.296021:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d600/0x5e4fb0a8aa198c54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa198c5b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756213.296032:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d600/0x5e4fb0a8aa198c54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa198c5b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782756213.296036:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d600/0x5e4fb0a8aa198c54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa198c5b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782756213.296039:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782756213.296046:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d600/0x5e4fb0a8aa198c54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198c5b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756213.296049:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782756213.296058:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d600/0x5e4fb0a8aa198c54 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198c5b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756213.296063:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d600/0x5e4fb0a8aa198c54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198c5b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756213.296072:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756213.296091:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756213.296092:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756213.296096:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782756213.296222:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222609536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782756213.296266:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756213.296298:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782756213.296304:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222609664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782756213.296325:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756213.296348:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782756213.296355:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0daec403-69b6-4c98-a0ea-f519ca0a480f:3315:1869355222609792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782756213.296383:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756213.296407:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222609536 00000100:00100000:2.0:1782756213.296411:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222609536 00010000:00010000:2.0:1782756213.296428:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198c77 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198c70 expref: 19 pid: 5798 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756213.296445:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222609664 00000100:00100000:2.0:1782756213.296448:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222609664 00010000:00010000:2.0:1782756213.296456:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198c69 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198c62 expref: 20 pid: 5797 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756213.296463:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222609792 00000100:00100000:2.0:1782756213.296465:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222609792 00010000:00010000:2.0:1782756213.296472:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c4a63dc00/0x5e4fb0a8aa198c5b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198c54 expref: 21 pid: 5797 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756213.296481:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782756213.296486:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c501d6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+21:3316:x1869355222609536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782756213.296495:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756213.296499:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198c77 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198c70 expref: 21 pid: 5798 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756213.296506:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198c77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198c70 expref: 21 pid: 5798 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756213.296518:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756213.296541:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c501d6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+21:3316:x1869355222609536:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756213.296547:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782756213.296587:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782756213.296598:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+20:3316:x1869355222609664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782756213.296604:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756213.296608:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198c69 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198c62 expref: 20 pid: 5797 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756213.296615:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198c69 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198c62 expref: 20 pid: 5797 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756213.296623:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756213.296641:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+20:3316:x1869355222609664:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756213.296645:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782756213.296656:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782756213.296662:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3315:x1869355222609792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782756213.296670:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756213.296673:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c4a63dc00/0x5e4fb0a8aa198c5b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198c54 expref: 19 pid: 5797 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756213.296681:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c4a63dc00/0x5e4fb0a8aa198c5b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198c54 expref: 19 pid: 5797 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756213.296689:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756213.296713:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3315:x1869355222609792:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756213.296718:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782756213.296754:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0daec403-69b6-4c98-a0ea-f519ca0a480f:3315:1869355222609792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782756213.296775:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222609664:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782756213.296989:0:11025:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198c77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa198c70 expref: 18 pid: 5798 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756213.297000:0:11025:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78edb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11025:1869355222609024:0@lo:104: 00010000:00010000:0.0:1782756213.297009:0:11025:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa198c69 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa198c62 expref: 17 pid: 5797 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756213.297017:0:11025:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78edb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11025:1869355222609152:0@lo:104: 00010000:00010000:0.0:1782756213.297024:0:11025:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4a63dc00/0x5e4fb0a8aa198c5b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa198c54 expref: 16 pid: 5797 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756213.297030:0:11025:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ed9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11025:1869355222609280:0@lo:104: 00000100:00100000:2.0:1782756213.297238:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222609536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782756213.300929:0:11025:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ed8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11025:1869355222608896:192.168.204.25@tcp:104: 00000100:00100000:2.0:1782756213.300943:0:11025:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ed8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11025:1869355222609408:192.168.204.25@tcp:104: 00010000:00010000:2.0:1782756213.300991:0:11025:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d3c4b81a600/0x5e4fb0a8aa198ca8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756213.301200:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756213.301222:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756213.301278:0:8367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209995904 00000100:00100000:0.0:1782756213.301278:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209996032 00000100:00100000:3.0:1782756213.301286:0:8367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209995904 00000100:00100000:0.0:1782756213.301287:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209996032 00010000:00010000:3.0:1782756213.301319:0:8367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c4b81a000/0x5e4fb0a8aa198c8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde16 expref: 14 pid: 5796 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756213.301319:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c4b81a400/0x5e4fb0a8aa198c4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cddde expref: 14 pid: 5798 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756213.301356:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 28 00000100:00100000:3.0:1782756213.301366:0:8367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 29 00000100:00100000:3.0:1782756213.301373:0:8367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+14:2356:x1869355209995904:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1782756213.301374:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+14:2356:x1869355209996032:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782756213.301388:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756213.301408:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c4b81a400/0x5e4fb0a8aa198c4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cddde expref: 14 pid: 5798 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756213.301434:0:8367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756213.301440:0:8367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c4b81a000/0x5e4fb0a8aa198c8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde16 expref: 14 pid: 5796 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756213.301608:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c4b81a400/0x5e4fb0a8aa198c4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cddde expref: 14 pid: 5798 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756213.301621:0:8367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c4b81a000/0x5e4fb0a8aa198c8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde16 expref: 14 pid: 5796 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756213.301697:0:8367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4b81a000/0x5e4fb0a8aa198c8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde16 expref: 14 pid: 5796 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756213.301697:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4b81a400/0x5e4fb0a8aa198c4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cddde expref: 14 pid: 5798 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756213.301714:0:8367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d3c4b81a600/0x5e4fb0a8aa198ca8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756213.301722:0:8367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4b81a600/0x5e4fb0a8aa198ca8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756213.301730:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782756213.301736:0:8367:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3c4b81a600/0x5e4fb0a8aa198ca8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756213.301742:0:8367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3c4b81a600/0x5e4fb0a8aa198ca8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756213.301748:0:8367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d3c4b81a600/0x5e4fb0a8aa198ca8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756213.301753:0:8367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d3c4b81a600/0x5e4fb0a8aa198ca8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756213.301759:0:8367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81a600 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756213.301762:0:8367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d3c4b81a600/0x5e4fb0a8aa198ca8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756213.301770:0:8367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d3c4b81a600/0x5e4fb0a8aa198ca8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756213.301792:0:8367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d3c4b81a600/0x5e4fb0a8aa198ca8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756213.301812:0:8367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782756213.301835:0:11025:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d3c4b81a600/0x5e4fb0a8aa198ca8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756213.301842:0:11025:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d3c4b81a600/0x5e4fb0a8aa198ca8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756213.301852:0:11025:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4b81a600/0x5e4fb0a8aa198ca8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756213.301913:0:8367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+12:2356:x1869355209995904:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 538us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756213.301913:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+12:2356:x1869355209996032:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 543us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756213.301921:0:8367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 29 00000100:00100000:0.0:1782756213.302041:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 28 00010000:00010000:1.0:1782756214.220650:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756214.572621:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756214.572719:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209996160 00000100:00100000:2.0:1782756214.572730:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209996160 00000100:00100000:2.0:1782756214.572908:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 220 00000100:00100000:2.0:1782756214.572919:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+11:5580:x1869355209996160:12345-192.168.204.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782756214.572937:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756214.572954:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4a63da00/0x5e4fb0a8aa198caf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cde40 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756214.572981:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4a63da00/0x5e4fb0a8aa198caf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde40 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756214.572992:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4a63da00/0x5e4fb0a8aa198caf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde40 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756214.573007:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63da00, rc 0) 00000100:00100000:2.0:1782756214.573123:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+12:5580:x1869355209996160:12345-192.168.204.25@tcp:101:ll_cfg_requeue.0 Request processed in 206us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756214.573130:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 220 00000100:00100000:3.0:1782756214.576407:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756214.576575:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209996288 00000100:00100000:0.0:1782756214.576585:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209996288 00000100:00100000:0.0:1782756214.576641:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 221 00000100:00100000:0.0:1782756214.576652:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+12:5580:x1869355209996288:12345-192.168.204.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782756214.576940:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+12:5580:x1869355209996288:12345-192.168.204.25@tcp:501:ll_cfg_requeue.0 Request processed in 289us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756214.576947:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 221 00000100:00100000:0.0:1782756214.579392:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756214.579475:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209996416 00000100:00100000:2.0:1782756214.579485:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209996416 00000100:00100000:2.0:1782756214.579538:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 222 00000100:00100000:2.0:1782756214.579546:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+12:5580:x1869355209996416:12345-192.168.204.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782756214.579751:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+12:5580:x1869355209996416:12345-192.168.204.25@tcp:503:ll_cfg_requeue.0 Request processed in 204us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756214.579758:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 222 00000100:00100000:0.0:1782756214.585380:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756214.585733:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209996544 00000100:00100000:1.0:1782756214.585742:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209996544 00000100:00100000:1.0:1782756214.585794:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 223 00000100:00100000:1.0:1782756214.585804:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+12:5580:x1869355209996544:12345-192.168.204.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782756214.585821:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756214.585838:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c41496800/0x5e4fb0a8aa198cb6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cde47 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756214.585871:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c41496800/0x5e4fb0a8aa198cb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde47 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756214.585883:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c41496800/0x5e4fb0a8aa198cb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde47 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756214.585893:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41496800, rc 0) 00000100:00100000:1.0:1782756214.585945:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:5580:x1869355209996544:12345-192.168.204.25@tcp:101:ll_cfg_requeue.0 Request processed in 142us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756214.585960:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 223 00000100:00100000:3.0:1782756214.591684:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756214.592051:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209996672 00000100:00100000:0.0:1782756214.592063:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209996672 00000100:00100000:0.0:1782756214.592411:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 224 00000100:00100000:0.0:1782756214.592423:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:5580:x1869355209996672:12345-192.168.204.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782756214.592744:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:5580:x1869355209996672:12345-192.168.204.25@tcp:501:ll_cfg_requeue.0 Request processed in 320us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756214.592762:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 224 00000100:00100000:0.0:1782756214.594783:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756214.594867:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209996800 00000100:00100000:1.0:1782756214.594876:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209996800 00000100:00100000:1.0:1782756214.594962:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 225 00000100:00100000:1.0:1782756214.594973:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:5580:x1869355209996800:12345-192.168.204.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782756214.595219:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:5580:x1869355209996800:12345-192.168.204.25@tcp:503:ll_cfg_requeue.0 Request processed in 247us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756214.595227:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 225 10000000:01000000:0.0:1782756214.670294:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782756214.670303:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9d3c80977000 from 7 10000000:01000000:0.0:1782756214.670308:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782756214.670371:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81bc00/0x5e4fb0a8aa198cbd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756214.670384:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81bc00/0x5e4fb0a8aa198cbd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756214.670395:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81bc00/0x5e4fb0a8aa198cbd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756214.670422:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78eda300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222609920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782756214.670494:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756214.670547:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222609920 00000100:00100000:0.0:1782756214.670553:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a04b780 going to sleep for 11 seconds 00000100:00100000:1.0:1782756214.670556:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222609920 00000100:00100000:1.0:1782756214.670605:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1782756214.670614:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:5800:x1869355222609920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782756214.670627:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756214.670639:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c41496400/0x5e4fb0a8aa198cc4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198cbd expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756214.670663:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c41496400/0x5e4fb0a8aa198cc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198cbd expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756214.670674:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c41496400/0x5e4fb0a8aa198cc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198cbd expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756214.670684:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41496400, rc 0) 00000100:00100000:1.0:1782756214.670721:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:5800:x1869355222609920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756214.670727:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1782756214.671648:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78eda300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222609920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782756214.671668:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81bc00/0x5e4fb0a8aa198cbd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198cc4 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756214.671678:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81bc00/0x5e4fb0a8aa198cbd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198cc4 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756214.673340:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c77208380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222610048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782756214.673404:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756214.673446:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a0526c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782756214.673949:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222610048 00000100:00100000:2.0:1782756214.673958:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222610048 00000100:00100000:2.0:1782756214.674013:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1782756214.674023:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:5800:x1869355222610048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782756214.674330:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:5800:x1869355222610048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 307us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756214.674338:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1782756214.674463:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c77208380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222610048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782756214.674503:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c77208380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222610176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782756214.674544:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756214.674575:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a0526c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782756214.674860:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222610176 00000100:00100000:2.0:1782756214.674866:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222610176 00000100:00100000:2.0:1782756214.674890:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1782756214.674897:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:5800:x1869355222610176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782756214.675056:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:5800:x1869355222610176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756214.675072:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1782756214.675132:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c77208380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222610176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1782756214.677985:0:11106:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1782756214.679545:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1782756214.679577:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782756214.679590:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81bc00/0x5e4fb0a8aa198cbd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198cc4 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756214.679603:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81bc00/0x5e4fb0a8aa198cbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198cc4 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782756214.679614:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782756214.679618:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9d3c4a734800 from 7 10000000:01000000:3.0:1782756214.679621:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782756214.679659:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4168ca00/0x5e4fb0a8aa198ccb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756214.679668:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c4168ca00/0x5e4fb0a8aa198ccb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756214.679680:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c4168ca00/0x5e4fb0a8aa198ccb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756214.679706:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222610304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782756214.679779:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756214.679866:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222610304 00000100:00100000:2.0:1782756214.679874:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222610304 00000100:00100000:3.0:1782756214.679920:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76d85d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782756214.679925:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1782756214.679934:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:5800:x1869355222610304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782756214.679950:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756214.679962:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4a63d800/0x5e4fb0a8aa198cd2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198ccb expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756214.679990:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4a63d800/0x5e4fb0a8aa198cd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198ccb expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756214.680001:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4a63d800/0x5e4fb0a8aa198cd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198ccb expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756214.680009:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63d800, rc 0) 00000100:00100000:2.0:1782756214.680057:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:5800:x1869355222610304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756214.680064:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1782756214.680245:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222610304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782756214.680260:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c4168ca00/0x5e4fb0a8aa198ccb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198cd2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756214.680268:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c4168ca00/0x5e4fb0a8aa198ccb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198cd2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756214.680321:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222610432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782756214.680348:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756214.680368:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76d85d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782756214.680379:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222610432 00000100:00100000:3.0:1782756214.680383:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222610432 00000100:00100000:3.0:1782756214.680412:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1782756214.680419:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:5800:x1869355222610432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782756214.680675:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:5800:x1869355222610432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756214.680683:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1782756214.680714:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222610432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782756214.680742:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222610560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782756214.680778:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756214.680793:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76d85d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782756214.681215:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222610560 00000100:00100000:3.0:1782756214.681220:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222610560 00000100:00100000:3.0:1782756214.681263:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1782756214.681272:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:5800:x1869355222610560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782756214.681444:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:5800:x1869355222610560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756214.681451:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1782756214.681567:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222610560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782756214.682519:0:11109:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1782756214.682666:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1782756214.682707:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782756214.682719:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4168ca00/0x5e4fb0a8aa198ccb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198cd2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756214.682731:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c4168ca00/0x5e4fb0a8aa198ccb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198cd2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782756214.682741:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782756214.682744:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9d3c4505a800 from 7 10000000:01000000:3.0:1782756214.682746:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782756214.682788:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4168cc00/0x5e4fb0a8aa198cd9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756214.682798:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c4168cc00/0x5e4fb0a8aa198cd9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756214.682807:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c4168cc00/0x5e4fb0a8aa198cd9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756214.682829:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222610688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782756214.682876:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756214.682912:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76d85480 going to sleep for 11 seconds 00000100:00100000:0.0:1782756214.683420:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222610688 00000100:00100000:0.0:1782756214.683438:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222610688 00000100:00100000:0.0:1782756214.683482:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1782756214.683491:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:5800:x1869355222610688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782756214.683503:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756214.683516:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4b81ba00/0x5e4fb0a8aa198ce0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198cd9 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756214.683539:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4b81ba00/0x5e4fb0a8aa198ce0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198cd9 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756214.683550:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4b81ba00/0x5e4fb0a8aa198ce0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198cd9 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756214.683559:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81ba00, rc 0) 00000100:00100000:0.0:1782756214.683653:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:5800:x1869355222610688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756214.683659:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1782756214.686283:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222610688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782756214.686313:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c4168cc00/0x5e4fb0a8aa198cd9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198ce0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756214.686365:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c4168cc00/0x5e4fb0a8aa198cd9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198ce0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756214.686443:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222610816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782756214.686500:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756214.687272:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76d85480 going to sleep for 11 seconds 00000100:00100000:0.0:1782756214.689267:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222610816 00000100:00100000:0.0:1782756214.689280:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222610816 00000100:00100000:0.0:1782756214.689338:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1782756214.689348:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:5800:x1869355222610816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782756214.689638:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:5800:x1869355222610816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (3137us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756214.689646:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1782756214.689762:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222610816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782756214.689827:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222610944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782756214.689872:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756214.689915:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76d85480 going to sleep for 11 seconds 00000100:00100000:1.0:1782756214.689975:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222610944 00000100:00100000:1.0:1782756214.689981:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222610944 00000100:00100000:1.0:1782756214.690014:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1782756214.690022:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:5800:x1869355222610944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782756214.690283:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:5800:x1869355222610944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 261us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756214.690291:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1782756214.690373:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222610944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782756214.691703:0:11110:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1782756214.691893:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1782756214.691928:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782756214.691939:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4168cc00/0x5e4fb0a8aa198cd9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198ce0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756214.691950:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c4168cc00/0x5e4fb0a8aa198cd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198ce0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756215.244248:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756215.758648:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222611072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782756215.758734:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756215.759189:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222611072 00000100:00100000:3.0:1782756215.759198:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222611072 00000100:00100000:3.0:1782756215.759271:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782756215.759279:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78eda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222611072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782756215.759316:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782756215.759370:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78eda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222611072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756215.759378:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1782756215.759417:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c78fc2680 x1869355222611072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756231 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756215.759436:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222611072:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782756215.759842:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1782756215.969800:0:11222:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1782756216.272194:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782756216.838528:0:6627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7b9f710d-49d5-44e3-9f56-6807ec02dbcd 00000020:00000080:2.0:1782756216.838540:0:6627:0:(genops.c:906:class_export_put()) final put ffff9d3c7fa71000/7b9f710d-49d5-44e3-9f56-6807ec02dbcd 00000020:00000080:0.0:1782756216.839205:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c7fa71000/7b9f710d-49d5-44e3-9f56-6807ec02dbcd for lustre-OST0000 00000020:00000080:0.0:1782756216.839263:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d3c7fa70800 for lustre-OST0000 00000100:00100000:1.0:1782756217.132268:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756217.132318:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756217.132357:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756217.132394:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209997184 00000100:00100000:1.0:1782756217.132405:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209997184 00000100:00100000:1.0:1782756217.132461:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209997056 00000100:00100000:1.0:1782756217.132465:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209997056 00000100:00100000:1.0:1782756217.132489:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 70 00000100:00100000:1.0:1782756217.132498:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2357:x1869355209997184:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1782756217.132575:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2357:x1869355209997184:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 78us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756217.132584:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 70 00000100:00100000:1.0:1782756217.132601:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 71 00000100:00100000:1.0:1782756217.132607:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7720a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+6:2357:x1869355209997056:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1782756217.132633:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7720a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+6:2357:x1869355209997056:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 26us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756217.132639:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 71 00000100:00080000:1.0:1782756217.132655:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782756217.133017:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209996928 00000100:00100000:3.0:1782756217.133022:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209996928 00000100:00100000:3.0:1782756217.133059:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 235 00000100:00100000:3.0:1782756217.133066:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2357:x1869355209996928:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756217.133145:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2357:x1869355209996928:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 80us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756217.133153:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 235 00000100:00100000:3.0:1782756217.292453:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782756217.292486:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78edad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869355222611328:0@lo:400:kworker.0 00000100:00100000:3.0:1782756217.292595:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756217.292661:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ed9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222611200:0@lo:400:kworker.0 00000100:00100000:1.0:1782756217.292688:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ed8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222611456:0@lo:400:kworker.0 00000100:00100000:3.0:1782756217.292698:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756217.292732:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ed9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222611840:0@lo:400:kworker.0 00000100:00100000:1.0:1782756217.292747:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756217.292773:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756217.292778:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782756217.292787:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78eda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222611584:0@lo:400:kworker.0 00000100:00100000:3.0:1782756217.292800:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782756217.292810:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869355222611712:0@lo:400:kworker.0 00000100:00100000:1.0:1782756217.292823:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756217.292868:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782756217.294600:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782756217.294616:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782756217.294637:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222611968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782756217.294728:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756217.294775:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222611328 00000100:00100000:3.0:1782756217.294781:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222611456 00000100:00100000:1.0:1782756217.294787:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222611328 00000100:00100000:3.0:1782756217.294801:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222611456 00000100:00100000:2.0:1782756217.294834:0:8071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222611968 00000100:00100000:2.0:1782756217.294842:0:8071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222611968 00000100:00100000:1.0:1782756217.294861:0:10416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222611840 00000100:00100000:1.0:1782756217.294867:0:10416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222611840 00000100:00100000:3.0:1782756217.294979:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222611712 00000100:00100000:3.0:1782756217.294985:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222611712 00000100:00100000:3.0:1782756217.295015:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1782756217.295028:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222611456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756217.295193:0:10416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222611584 00000100:00100000:2.0:1782756217.295194:0:8071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782756217.295207:0:10416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222611584 00000100:00100000:1.0:1782756217.295240:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782756217.295329:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3317:x1869355222611840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756217.295330:0:8071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1869355222611968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782756217.295378:0:8071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782756217.295408:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3317:x1869355222611840:12345-0@lo:400:kworker.0 Request processed in 159us (2634us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756217.295417:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782756217.295429:0:8071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1869355222611968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 223us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756217.295437:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782756217.295438:0:8071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782756217.295448:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222611584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756217.295496:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222611584:12345-0@lo:400:kworker.0 Request processed in 49us (2672us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756217.295504:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782756217.295568:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222611456:12345-0@lo:400:kworker.0 Request processed in 537us (2815us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756217.295590:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1782756217.295633:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1782756217.295642:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869355222611712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782756217.295686:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869355222611712:12345-0@lo:400:kworker.0 Request processed in 44us (2818us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756217.295694:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1782756217.295740:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222611200 00000100:00100000:3.0:1782756217.295746:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222611200 00000100:00100000:3.0:1782756217.295799:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1782756217.295813:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3317:x1869355222611200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782756217.295867:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3317:x1869355222611200:12345-0@lo:400:kworker.0 Request processed in 59us (3167us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756217.295875:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00080000:1.0:1782756217.295968:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782756217.295974:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782756217.295980:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782756217.296045:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869355222611712:0@lo:400:kworker.0 00010000:00080000:1.0:1782756217.296070:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c78ed9500 x1869355222611840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1782756217.296101:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c7fb74a80 x1869355222611968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756217.296115:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ed9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222611840:0@lo:400:kworker.0 00000100:00100000:2.0:1782756217.296128:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222611968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782756217.296138:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ed9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222611200:0@lo:400:kworker.0 00010000:00080000:1.0:1782756217.296214:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c78eda680 x1869355222611584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756217.296226:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78eda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222611584:0@lo:400:kworker.0 00000100:00100000:1.0:1782756217.296241:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ed8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222611456:0@lo:400:kworker.0 00000100:00100000:1.0:1782756217.296897:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1782756217.296919:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869355222611328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756217.297273:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869355222611328:12345-0@lo:400:kworker.0 Request processed in 357us (4677us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756217.297282:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782756217.297380:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78edad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869355222611328:0@lo:400:kworker.0 00010000:00010000:2.0:1782756218.318212:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782756218.510809:0:11323:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 14:03:37 (1782756217) === 00000100:00100000:1.0:1782756218.646173:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756218.646216:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756218.646247:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209997312 00000100:00100000:1.0:1782756218.646257:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209997312 00000100:00100000:1.0:1782756218.646310:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14 00000100:00100000:1.0:1782756218.646321:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77208700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+6:2358:x1869355209997312:12345-192.168.204.25@tcp:41:mkdir.0 00000004:00000024:1.0:1782756218.646368:0:6579:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1782756218.646443:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77208700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+6:2358:x1869355209997312:12345-192.168.204.25@tcp:41:mkdir.0 Request processed in 124us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756218.646450:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14 00000100:00100000:2.0:1782756218.646619:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209997440 00000100:00100000:2.0:1782756218.646624:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209997440 00000100:00100000:2.0:1782756218.646659:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 0 00000100:00100000:2.0:1782756218.646667:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:26487635-60cb-4aee-af8e-396654f6c3d8+6:9653:x1869355209997440:12345-192.168.204.25@tcp:700:mkdir.0 00000100:00100000:2.0:1782756218.646717:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:26487635-60cb-4aee-af8e-396654f6c3d8+6:9653:x1869355209997440:12345-192.168.204.25@tcp:700:mkdir.0 Request processed in 51us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756218.646724:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 0 00000100:00100000:1.0:1782756218.651237:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756218.651319:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209997696 00000100:00100000:2.0:1782756218.651329:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209997696 00000100:00100000:2.0:1782756218.651387:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15 00000100:00100000:2.0:1782756218.651396:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+6:9653:x1869355209997696:12345-192.168.204.25@tcp:36:mkdir.0 00010000:00010000:2.0:1782756218.651471:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756218.651537:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa198bc8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cddc9 expref: 6 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756218.651558:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c58212300) 00010000:00010000:2.0:1782756218.651582:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782756218.651930:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198ce7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756218.651943:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198ce7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756218.651952:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198ce7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756218.651979:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa198cee lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756218.651987:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa198cee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756218.651993:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa198cee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756218.653260:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1782756218.653273:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198ce7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756218.653282:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198ce7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756218.653289:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198ce7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756218.653300:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63de00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756218.653305:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198ce7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756218.653312:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198ce7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756218.653324:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:2.0:1782756218.653327:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756218.653330:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198ce7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756218.653337:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198ce7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782756218.653355:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000047a24dea reply state 0000000053ffdcba transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa198cee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756218.653363:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782756218.653447:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+7:9653:x1869355209997696:12345-192.168.204.25@tcp:36:mkdir.0 Request processed in 2049us (2218us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1782756218.653456:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15 00010000:00010000:1.0:1782756218.667006:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa198cee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.667025:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa198cee lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.667033:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa198cee lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.667038:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63c600 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756218.667043:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa198cee lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.667051:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa198cee lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.667104:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d3c58212d00) 00010000:00010000:1.0:1782756218.667107:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756218.667112:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa198cee lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.667118:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa198cee lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756218.669170:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756218.669238:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209997824 00000100:00100000:1.0:1782756218.669247:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209997824 00000100:00100000:1.0:1782756218.669328:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16 00000100:00100000:1.0:1782756218.669339:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78edad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+6:9654:x1869355209997824:12345-192.168.204.25@tcp:101:chmod.0 00010000:00010000:1.0:1782756218.669360:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756218.669381:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa198cf5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cde4e expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.669442:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa198cfc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.669456:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa198cfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.669467:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa198cfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756218.669528:0:6579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1782756218.669531:0:6579:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1782756218.669572:0:6579:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa198cfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.669613:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa198cf5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde4e expref: 8 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.669633:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa198cfc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde4e expref: 7 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.669641:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c4ef38500) 00010000:00010000:1.0:1782756218.669644:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782756218.669647:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41497e00, rc 0) 00000100:00100000:1.0:1782756218.669701:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78edad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+7:9654:x1869355209997824:12345-192.168.204.25@tcp:101:chmod.0 Request processed in 363us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756218.669708:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16 00000100:00100000:1.0:1782756218.676345:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756218.676599:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209998080 00000100:00100000:2.0:1782756218.676608:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209998080 00000100:00100000:2.0:1782756218.676691:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17 00000100:00100000:2.0:1782756218.676701:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7720bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+7:9654:x1869355209998080:12345-192.168.204.25@tcp:36:chmod.0 00010000:00010000:2.0:1782756218.676750:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756218.676777:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa198cfc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde4e expref: 7 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756218.676805:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c4ef38500) 00010000:00010000:2.0:1782756218.676815:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782756218.676912:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198d03 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756218.676925:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198d03 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756218.676935:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198d03 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782756218.677623:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000012826fd8 reply state 00000000e85ad09b transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198d03 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756218.677636:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782756218.677652:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1782756218.677744:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7720bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+8:9654:x1869355209998080:12345-192.168.204.25@tcp:36:chmod.0 Request processed in 1042us (1406us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1782756218.677753:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17 00010000:00010000:0.0:1782756218.682236:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198d03 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756218.682255:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198d03 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756218.682264:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198d03 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756218.682270:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63de00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756218.682276:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198d03 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756218.682284:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198d03 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756218.682305:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:0.0:1782756218.682308:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782756218.682313:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198d03 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756218.682320:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198d03 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756218.701052:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756218.701118:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209998208 00000100:00100000:0.0:1782756218.701133:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209998208 00000100:00100000:0.0:1782756218.701217:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18 00000100:00100000:0.0:1782756218.701229:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+7:9655:x1869355209998208:12345-192.168.204.25@tcp:101:chown.0 00010000:00010000:0.0:1782756218.701258:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756218.701280:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a400/0x5e4fb0a8aa198d0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cde55 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756218.701374:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198d11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756218.701389:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198d11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756218.701401:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198d11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782756218.701464:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1782756218.701468:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1782756218.701505:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198d11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756218.701531:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a400/0x5e4fb0a8aa198d0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde55 expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756218.701547:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198d11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde55 expref: 8 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756218.701555:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c54288f00) 00010000:00010000:0.0:1782756218.701558:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782756218.701561:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81a000, rc 0) 00000100:00100000:0.0:1782756218.701623:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+8:9655:x1869355209998208:12345-192.168.204.25@tcp:101:chown.0 Request processed in 396us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756218.701630:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18 00000100:00100000:1.0:1782756218.706561:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756218.706629:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209998336 00000100:00100000:2.0:1782756218.706641:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209998336 00000100:00100000:2.0:1782756218.706748:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19 00000100:00100000:2.0:1782756218.706760:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7720b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+8:9655:x1869355209998336:12345-192.168.204.25@tcp:101:chown.0 00010000:00010000:2.0:1782756218.706782:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756218.706803:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c200/0x5e4fb0a8aa198d18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cde5c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756218.706875:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa198d1f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756218.706905:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa198d1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756218.706916:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa198d1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756218.706950:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa198d26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756218.706958:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa198d26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756218.706966:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa198d26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756218.707066:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d400/0x5e4fb0a8aa198d2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756218.707119:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d400/0x5e4fb0a8aa198d2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756218.707131:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d400/0x5e4fb0a8aa198d2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782756218.707957:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1782756218.707966:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782756218.708021:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d400/0x5e4fb0a8aa198d2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.708038:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa198d1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.708045:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa198d1f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.708053:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa198d1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.708059:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63cc00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756218.708064:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa198d1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.708112:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa198d1f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.708128:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c54288f00) 00010000:00010000:3.0:1782756218.708132:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756218.708138:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa198d1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.708144:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa198d1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.708172:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa198d26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.708178:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa198d26 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.708184:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa198d26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.708190:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63dc00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756218.708193:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa198d26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.708198:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa198d26 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.708206:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d3c58212300) 00010000:00010000:3.0:1782756218.708208:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756218.708211:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa198d26 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.708228:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa198d26 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.708269:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c200/0x5e4fb0a8aa198d18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde5c expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.708283:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d400/0x5e4fb0a8aa198d2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde5c expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.708525:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d3c58212000) 00010000:00010000:3.0:1782756218.708530:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782756218.708532:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63d400, rc 0) 00000100:00100000:3.0:1782756218.708684:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7720b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+9:9655:x1869355209998336:12345-192.168.204.25@tcp:101:chown.0 Request processed in 1925us (2129us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756218.708694:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19 00000100:00100000:2.0:1782756218.715209:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756218.715487:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209998592 00000100:00100000:0.0:1782756218.715497:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209998592 00000100:00100000:0.0:1782756218.715580:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20 00000100:00100000:0.0:1782756218.715592:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+9:9655:x1869355209998592:12345-192.168.204.25@tcp:36:chown.0 00010000:00010000:0.0:1782756218.715647:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756218.715675:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d400/0x5e4fb0a8aa198d2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde5c expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756218.715698:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d3c58212000) 00010000:00010000:0.0:1782756218.715709:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782756218.715735:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a400/0x5e4fb0a8aa198d34 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756218.715952:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a400/0x5e4fb0a8aa198d34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756218.715967:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a400/0x5e4fb0a8aa198d34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782756218.761261:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1782756218.761395:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000600bd163 reply state 000000003c4201ff transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a400/0x5e4fb0a8aa198d34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756218.761411:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782756218.761645:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:0.0:1782756218.761804:0:5804:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1782756218.761836:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+7:9655:x1869355209998592:12345-192.168.204.25@tcp:36:chown.0 Request processed in 46243us (46637us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1782756218.761846:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20 00010000:00010000:3.0:1782756218.761973:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a400/0x5e4fb0a8aa198d34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.761983:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a400/0x5e4fb0a8aa198d34 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.761989:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a400/0x5e4fb0a8aa198d34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.761994:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81a400 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756218.761999:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a400/0x5e4fb0a8aa198d34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.762006:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a400/0x5e4fb0a8aa198d34 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.762040:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d3c54288e00) 00010000:00010000:3.0:1782756218.762044:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782756218.762049:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a400/0x5e4fb0a8aa198d34 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.762054:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a400/0x5e4fb0a8aa198d34 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756218.782266:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756218.782362:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209998720 00000100:00100000:1.0:1782756218.782372:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209998720 00000100:00100000:1.0:1782756218.782438:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 21 00000100:00100000:1.0:1782756218.782449:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+6:9656:x1869355209998720:12345-192.168.204.25@tcp:101:touch.500 00010000:00010000:1.0:1782756218.782477:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756218.782497:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa198d3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cde63 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782756218.784132:0:5803:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1564us 00010000:00010000:3.0:1782756218.802803:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa198d42 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.802835:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa198d42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.802855:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa198d42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.802877:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa198d49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.802885:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa198d49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.802894:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa198d49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.803561:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa198d50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.803579:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa198d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.803593:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa198d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782756218.803667:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782756218.803673:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782756218.803787:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa198d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.803804:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa198d42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.803812:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa198d42 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.803821:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa198d42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.803827:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168c200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756218.803833:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa198d42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.803842:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa198d42 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.803857:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c54288f00) 00010000:00010000:3.0:1782756218.803861:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756218.803867:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa198d42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.803874:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa198d42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.803903:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa198d49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.803910:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa198d49 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.803916:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa198d49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.803922:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168c400 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756218.803926:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa198d49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.803932:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa198d49 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.803941:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d3c49e15900) 00010000:00010000:3.0:1782756218.803944:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756218.803947:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa198d49 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.803952:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa198d49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.804001:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa198d3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde63 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.804018:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa198d50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde63 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.804033:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d3c49e15400) 00010000:00010000:3.0:1782756218.804035:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782756218.804037:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168d200, rc 0) 00000100:00100000:3.0:1782756218.804177:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+7:9656:x1869355209998720:12345-192.168.204.25@tcp:101:touch.500 Request processed in 21728us (21920us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756218.804186:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 21 00000100:00100000:0.0:1782756218.808270:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756218.808358:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209998976 00000100:00100000:1.0:1782756218.808367:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209998976 00000100:00100000:1.0:1782756218.808461:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 22 00000100:00100000:1.0:1782756218.808471:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+7:9656:x1869355209998976:12345-192.168.204.25@tcp:101:touch.500 00010000:00010000:1.0:1782756218.808493:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756218.808512:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497200/0x5e4fb0a8aa198d57 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cde6a expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.808964:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa198d5e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.808979:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa198d5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.808990:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa198d5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.809029:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa198d65 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.809037:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa198d65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.809044:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa198d65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782756218.810515:0:6579:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1782756218.811267:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa198d6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.811287:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa198d6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.811299:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa198d6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.811355:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa198d5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.811364:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa198d5e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.811372:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa198d5e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.811379:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41497e00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756218.811384:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa198d5e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.811392:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa198d5e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.811408:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d3c49e15400) 00010000:00010000:1.0:1782756218.811412:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756218.811418:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa198d5e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.811425:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa198d5e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782756218.811439:0:6579:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000029effac8 reply state 0000000051a26b7a transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa198d65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756218.811447:0:6579:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782756218.811487:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497200/0x5e4fb0a8aa198d57 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde6a expref: 10 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.811516:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa198d6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde6a expref: 9 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.811523:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d3c4ef38700) 00010000:00010000:1.0:1782756218.811525:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782756218.811527:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef4200, rc 0) 00000100:00100000:1.0:1782756218.811743:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+10:9656:x1869355209998976:12345-192.168.204.25@tcp:101:touch.500 Request processed in 3262us (3471us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1782756218.811753:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 22 00010000:00010000:3.0:1782756218.813640:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa198d65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.813664:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa198d65 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.813672:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa198d65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.813680:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4e00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756218.813686:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa198d65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.813694:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa198d65 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.813714:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa11b4155 (ffff9d3c4ef38300) 00010000:00010000:3.0:1782756218.813718:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756218.813723:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa198d65 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.813730:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa198d65 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756218.814635:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756218.814744:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209999232 00000100:00100000:3.0:1782756218.814759:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209999232 00000100:00100000:3.0:1782756218.815045:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 23 00000100:00100000:3.0:1782756218.815059:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78eda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+9:9656:x1869355209999232:12345-192.168.204.25@tcp:36:touch.500 00010000:00010000:3.0:1782756218.815298:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756218.815329:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa198d6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde6a expref: 9 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.815348:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d3c4ef38700) 00010000:00010000:3.0:1782756218.815360:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782756218.815417:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa198d7a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.815490:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa198d7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.815503:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa198d7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782756218.815746:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000ec33ba6 reply state 0000000089abc37d transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa198d7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756218.815758:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782756218.816017:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78eda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+10:9656:x1869355209999232:12345-192.168.204.25@tcp:36:touch.500 Request processed in 960us (1391us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1782756218.816027:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 23 00010000:00010000:0.0:1782756218.820310:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa198d7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756218.820361:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa198d7a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756218.820370:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa198d7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756218.820376:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168d600 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756218.820382:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa198d7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756218.820390:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa198d7a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756218.820411:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d3c49e15500) 00010000:00010000:0.0:1782756218.820415:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756218.820491:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa198d7a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756218.820501:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa198d7a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756218.820853:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756218.820921:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209999360 00000100:00100000:1.0:1782756218.820935:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209999360 00000100:00100000:1.0:1782756218.821010:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 24 00000100:00100000:1.0:1782756218.821022:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ed9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+9:9656:x1869355209999360:12345-192.168.204.25@tcp:101:touch.500 00010000:00010000:1.0:1782756218.821058:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756218.821144:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa198d81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cde71 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.821231:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa198d81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde71 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.821248:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa198d81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde71 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.821269:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:1.0:1782756218.821272:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782756218.821298:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef4c00, rc 0) 00000100:00100000:1.0:1782756218.821369:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ed9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+10:9656:x1869355209999360:12345-192.168.204.25@tcp:101:touch.500 Request processed in 349us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756218.821376:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 24 00000100:00100000:1.0:1782756218.827018:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756218.827134:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209999488 00000100:00100000:3.0:1782756218.827158:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209999488 00000100:00100000:3.0:1782756218.827240:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16 00000100:00100000:3.0:1782756218.827250:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7720b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2354:x1869355209999488:12345-192.168.204.25@tcp:8:touch.500 00010000:00080000:3.0:1782756218.827292:0:6605:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 26487635-60cb-4aee-af8e-396654f6c3d8@192.168.204.25@tcp t0 exp 0000000000000000 cur 260 last 0 00000020:00000080:3.0:1782756218.827340:0:6605:0:(genops.c:1406:class_connect()) connect: client 26487635-60cb-4aee-af8e-396654f6c3d8, cookie 0x5e4fb0a8aa198d88 00002000:00100000:3.0:1782756218.827356:0:6605:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 26487635-60cb-4aee-af8e-396654f6c3d8/ffff9d3c7b93e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782756218.827389:0:6605:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782756218.827940:0:6605:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782756218.827983:0:6605:0:(import.c:65:import_set_state_nolock()) ffff9d3c77037000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782756218.828244:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7720b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+6:2354:x1869355209999488:12345-192.168.204.25@tcp:8:touch.500 Request processed in 993us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756218.828255:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16 00000100:00100000:1.0:1782756218.831834:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756218.832005:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209999616 00000100:00100000:3.0:1782756218.832019:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209999616 00000100:00100000:3.0:1782756218.832134:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17 00000100:00100000:3.0:1782756218.832159:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7720b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+6:0:x1869355209999616:12345-192.168.204.25@tcp:2:touch.500 00000100:00080000:1.0:1782756218.832562:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1782756218.863795:0:6627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:0.0:1782756218.863814:0:6627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 26487635-60cb-4aee-af8e-396654f6c3d8 00000100:00100000:1.0:1782756218.864191:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7720b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+5:0:x1869355209999616:12345-192.168.204.25@tcp:2:touch.500 Request processed in 32033us (32359us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1782756218.864210:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17 00000100:00100000:0.0:1782756218.870678:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756218.870856:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355209999872 00000100:00100000:1.0:1782756218.870868:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355209999872 00000100:00100000:1.0:1782756218.871098:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 2 00000100:00100000:1.0:1782756218.871110:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+10:9656:x1869355209999872:12345-192.168.204.25@tcp:35:touch.500 00000100:00100000:1.0:1782756218.872203:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+11:9656:x1869355209999872:12345-192.168.204.25@tcp:35:touch.500 Request processed in 1089us (1530us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1782756218.872214:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 2 00000100:00100000:2.0:1782756218.898959:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756218.899173:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210000000 00000100:00100000:1.0:1782756218.899183:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210000000 00000100:00100000:1.0:1782756218.899252:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 25 00000100:00100000:1.0:1782756218.899262:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+11:9657:x1869355210000000:12345-192.168.204.25@tcp:101:rm.0 00010000:00010000:1.0:1782756218.899291:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756218.899317:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa198d8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cde78 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.899396:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa198d96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.899434:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa198d96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.899445:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa198d96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756218.899509:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782756218.899513:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1782756218.899552:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa198d96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.899578:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa198d8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde78 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.899596:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa198d96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde78 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.899606:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d3c49e15400) 00010000:00010000:1.0:1782756218.899609:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782756218.899612:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef5c00, rc 0) 00000100:00100000:1.0:1782756218.899664:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+12:9657:x1869355210000000:12345-192.168.204.25@tcp:101:rm.0 Request processed in 404us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756218.899671:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 25 00000100:00100000:2.0:1782756218.904601:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756218.904685:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210000256 00000100:00100000:1.0:1782756218.904694:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210000256 00000100:00100000:1.0:1782756218.904746:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 26 00000100:00100000:1.0:1782756218.904755:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+12:9657:x1869355210000256:12345-192.168.204.25@tcp:101:rm.0 00010000:00010000:1.0:1782756218.904772:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756218.904802:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa198d9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cde7f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756218.904924:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1782756218.905116:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa198d9d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde7f expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.905132:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c54288f00) 00010000:00010000:1.0:1782756218.905135:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782756218.905141:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa198d9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde7f expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.905165:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef5200, rc 0) 00000100:00100000:1.0:1782756218.905226:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+13:9657:x1869355210000256:12345-192.168.204.25@tcp:101:rm.0 Request processed in 472us (634us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1782756218.905231:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 26 00000100:00100000:0.0:1782756218.908692:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756218.908818:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210000384 00000100:00100000:2.0:1782756218.908838:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210000384 00000100:00100000:2.0:1782756218.908929:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3 00000100:00100000:2.0:1782756218.908961:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+13:9657:x1869355210000384:12345-192.168.204.25@tcp:37:rm.0 00000100:00100000:2.0:1782756218.913761:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+13:9657:x1869355210000384:12345-192.168.204.25@tcp:37:rm.0 Request processed in 4791us (5067us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756218.913777:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3 00000100:00100000:3.0:1782756218.918492:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756218.918621:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210000640 00000100:00100000:1.0:1782756218.918633:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210000640 00000100:00100000:1.0:1782756218.918741:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 4 00000100:00100000:1.0:1782756218.918752:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4977fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+13:9657:x1869355210000640:12345-192.168.204.25@tcp:35:rm.0 00000100:00100000:1.0:1782756218.919034:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4977fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+14:9657:x1869355210000640:12345-192.168.204.25@tcp:35:rm.0 Request processed in 282us (550us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1782756218.919043:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 4 00000100:00100000:0.0:1782756218.923401:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756218.923555:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210000896 00000100:00100000:3.0:1782756218.923564:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210000896 00000100:00100000:3.0:1782756218.923631:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 27 00000100:00100000:3.0:1782756218.923642:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+14:9657:x1869355210000896:12345-192.168.204.25@tcp:101:rm.0 00010000:00010000:3.0:1782756218.923681:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756218.923701:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa198dab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cde86 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.923837:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa198db2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.923864:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa198db2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.923875:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa198db2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782756218.923886:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1782756218.924039:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa198dab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde86 expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.924061:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa198db2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde86 expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.924154:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d3c49e15400) 00010000:00010000:3.0:1782756218.924157:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782756218.924160:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168c200, rc 0) 00000100:00100000:3.0:1782756218.924440:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+16:9657:x1869355210000896:12345-192.168.204.25@tcp:101:rm.0 Request processed in 799us (1048us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1782756218.924448:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 27 00000100:00100000:2.0:1782756218.932811:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756218.932997:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210001024 00000100:00100000:1.0:1782756218.933121:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210001024 00000100:00100000:1.0:1782756218.933195:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 28 00000100:00100000:1.0:1782756218.933206:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+16:9657:x1869355210001024:12345-192.168.204.25@tcp:41:rm.0 00000004:00000024:1.0:1782756218.933285:0:5804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1782756218.933360:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+16:9657:x1869355210001024:12345-192.168.204.25@tcp:41:rm.0 Request processed in 156us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756218.933368:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 28 00000100:00100000:2.0:1782756218.938614:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756218.938700:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210001152 00000100:00100000:3.0:1782756218.938710:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210001152 00000100:00100000:3.0:1782756218.938770:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 29 00000100:00100000:3.0:1782756218.938781:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+16:9657:x1869355210001152:12345-192.168.204.25@tcp:101:rm.0 00010000:00010000:3.0:1782756218.938802:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756218.938823:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa198dc0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cde8d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.938921:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa198dc7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.938936:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa198dc7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.938947:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa198dc7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.938962:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497200/0x5e4fb0a8aa198dce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.938969:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497200/0x5e4fb0a8aa198dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.938977:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497200/0x5e4fb0a8aa198dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.939215:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa198dd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.939225:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa198dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.939231:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa198dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782756218.939262:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1782756218.939267:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782756218.939284:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa198dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.939600:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa198dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.939612:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa198dc7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.939619:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa198dc7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.939625:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa198dc7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.939632:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168d600 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756218.939636:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa198dc7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.939643:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa198dc7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.939656:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d3c49e15400) 00010000:00010000:3.0:1782756218.939659:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756218.939663:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa198dc7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.939670:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa198dc7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.939684:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497200/0x5e4fb0a8aa198dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.939690:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497200/0x5e4fb0a8aa198dce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.939703:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497200/0x5e4fb0a8aa198dce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.939708:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41497200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756218.939711:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497200/0x5e4fb0a8aa198dce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.939718:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497200/0x5e4fb0a8aa198dce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.939726:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa11b4155 (ffff9d3c49e15600) 00010000:00010000:3.0:1782756218.939729:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756218.939731:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497200/0x5e4fb0a8aa198dce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.939736:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497200/0x5e4fb0a8aa198dce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.939771:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa198dc0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde8d expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.939786:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa198dd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde8d expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.939793:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:3.0:1782756218.939795:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782756218.939798:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41497e00, rc 0) 00000100:00100000:3.0:1782756218.940025:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+17:9657:x1869355210001152:12345-192.168.204.25@tcp:101:rm.0 Request processed in 1243us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756218.940041:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 29 00000100:00100000:0.0:1782756218.946349:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756218.946692:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210001408 00000100:00100000:1.0:1782756218.946703:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210001408 00000100:00100000:1.0:1782756218.946771:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 30 00000100:00100000:1.0:1782756218.946781:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+17:9657:x1869355210001408:12345-192.168.204.25@tcp:36:rm.0 00010000:00010000:1.0:1782756218.946840:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1782756218.947034:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa198dd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde8d expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.947058:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa198d81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde71 expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.947069:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:1.0:1782756218.947116:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa198d96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde78 expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.947125:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d3c49e15400) 00010000:00010000:1.0:1782756218.947128:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782756218.947158:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa198ddc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.947172:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa198ddc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.947182:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa198ddc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.947208:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa198de3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.947213:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa198de3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.947217:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa198de3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.947334:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa198dea lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.947341:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa198dea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.947347:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa198dea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782756218.948287:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1782756218.948300:0:5804:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 260183224228ns, next at 261183221653ns, rc = 0 00010000:00010000:1.0:1782756218.948364:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa198df1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.948388:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa198df1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.948579:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa198df1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.948591:0:5804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa198df1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.948609:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa198df1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.948615:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa198df1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.948639:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782756218.948659:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa198dea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.948666:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa198dea lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.948672:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa198dea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.948675:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756218.948678:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa198dea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.948683:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa198dea lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.948690:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d3c4ef38600) 00010000:00010000:1.0:1782756218.948692:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782756218.948694:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa198dea lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.948697:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa198dea lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.948709:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa198ddc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.948717:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa198ddc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.948721:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa198ddc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.948724:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756218.948726:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa198ddc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.948729:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa198ddc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.948734:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d3c49e15400) 00010000:00010000:1.0:1782756218.948736:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756218.948740:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa198ddc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.948745:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa198ddc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756218.948751:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00010000:1.0:1782756218.948755:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004e7f66c1 reply state 00000000f32bded6 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa198de3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756218.948764:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782756218.948769:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa198df1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756218.948779:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4400 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:2.0:1782756218.948783:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa198df1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756218.948792:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa198df1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756218.948804:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d3c4ef38600) 00010000:00010000:2.0:1782756218.948807:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782756218.948811:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa198df1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756218.948818:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa198df1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756218.948834:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756218.948836:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756218.948838:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756218.948894:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+16:9657:x1869355210001408:12345-192.168.204.25@tcp:36:rm.0 Request processed in 2112us (2552us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1782756218.948903:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 30 00010000:00010000:3.0:1782756218.952093:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa198de3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.952112:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa198de3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.952119:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa198de3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.952124:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5600 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756218.952129:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa198de3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.952136:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa198de3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.952165:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa11b4155 (ffff9d3c4ef38400) 00010000:00010000:3.0:1782756218.952170:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756218.952176:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa198de3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756218.952182:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa198de3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa11b4155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756218.954267:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756218.955062:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210001664 00000100:00100000:2.0:1782756218.955105:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210001664 00000100:00100000:2.0:1782756218.955245:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5 00000100:00100000:2.0:1782756218.955259:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+15:9657:x1869355210001664:12345-192.168.204.25@tcp:35:rm.0 00000100:00100000:2.0:1782756218.955568:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+16:9657:x1869355210001664:12345-192.168.204.25@tcp:35:rm.0 Request processed in 312us (1308us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1782756218.955577:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5 00000100:00100000:2.0:1782756218.959399:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756218.959461:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210001920 00000100:00100000:1.0:1782756218.959472:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210001920 00000100:00100000:1.0:1782756218.959723:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 31 00000100:00100000:1.0:1782756218.959735:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+16:9657:x1869355210001920:12345-192.168.204.25@tcp:36:rm.0 00010000:00010000:1.0:1782756218.959798:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1782756218.959826:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa198db2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde86 expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.959847:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa198d50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde63 expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.959870:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d3c49e15400) 00010000:00010000:1.0:1782756218.959885:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198d11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde55 expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.959894:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c54288f00) 00010000:00010000:1.0:1782756218.959900:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782756218.959922:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa198df8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.959934:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa198df8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.959951:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa198df8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.959963:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa198dff lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.959970:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa198dff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.959989:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa198dff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.960359:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa198e06 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.960368:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa198e06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.960375:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa198e06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756218.961007:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1782756218.961025:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa198e06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.961033:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa198e06 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.961039:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa198e06 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.961045:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5c00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756218.961050:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa198e06 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.961058:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa198e06 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.961068:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d3c4ef38e00) 00010000:00010000:1.0:1782756218.961070:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782756218.961102:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa198e06 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.961109:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa198e06 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.961128:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa198df8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.961134:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa198df8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.961139:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa198df8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.961143:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756218.961159:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa198df8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.961166:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa198df8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.961175:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:1.0:1782756218.961177:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756218.961179:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa198df8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756218.961185:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa198df8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782756218.961196:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eb2e5db6 reply state 00000000586ba4e4 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa198dff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756218.961215:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782756218.961313:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+15:9657:x1869355210001920:12345-192.168.204.25@tcp:36:rm.0 Request processed in 1578us (1922us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1782756218.961321:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 31 00010000:00010000:0.0:1782756218.964161:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa198dff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756218.964195:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa198dff lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756218.964204:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa198dff lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756218.964210:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756218.964215:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa198dff lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756218.964223:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa198dff lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756218.964241:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d3c4ef38800) 00010000:00010000:0.0:1782756218.964246:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756218.964249:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa198dff lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756218.964256:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa198dff lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756219.341281:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756220.364486:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782756220.876309:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222612096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782756220.876381:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756220.876513:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222612096 00000100:00100000:0.0:1782756220.876522:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222612096 00000100:00080000:1.0:1782756220.876603:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782756220.876608:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782756220.876624:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222612096:12345-0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1782756220.876636:0:6795:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 262111559499ns, next at 263111557053ns, rc = 0 00002000:00000024:1.0:1782756220.876682:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782756220.876736:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222612096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (353us total) trans 0 rc 0/0 00010000:00080000:2.0:1782756220.876741:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c7fb9d180 x1869355222612096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756236 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756220.876744:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782756220.876761:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222612096:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782756221.388286:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782756221.791440:0:11471:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:2.0:1782756222.249141:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756222.249242:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756222.249292:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756222.249324:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756222.249362:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210002048 00000100:00100000:0.0:1782756222.249383:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210002048 00000100:00100000:0.0:1782756222.249447:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 237 00000100:00100000:0.0:1782756222.249459:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2358:x1869355210002048:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756222.249551:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2358:x1869355210002048:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 94us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756222.249558:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 237 00000100:00100000:0.0:1782756222.249595:0:10416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210002304 00000100:00100000:0.0:1782756222.249599:0:10416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210002304 00000100:00100000:0.0:1782756222.249637:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 41 00000100:00100000:0.0:1782756222.249643:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78edb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+5:2358:x1869355210002304:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756222.249674:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78edb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+5:2358:x1869355210002304:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 31us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756222.249681:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 41 00000100:00080000:0.0:1782756222.249812:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782756222.249919:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210002176 00000100:00100000:2.0:1782756222.249924:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210002176 00000100:00100000:2.0:1782756222.249975:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210002432 00000100:00100000:2.0:1782756222.249978:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210002432 00000100:00100000:2.0:1782756222.250001:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 75 00000100:00100000:2.0:1782756222.250008:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+14:2358:x1869355210002176:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:2.0:1782756222.250049:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+14:2358:x1869355210002176:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 42us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756222.250055:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 75 00000100:00100000:2.0:1782756222.250067:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 76 00000100:00100000:2.0:1782756222.250106:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78edb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2358:x1869355210002432:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:2.0:1782756222.250141:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78edb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2358:x1869355210002432:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 68us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756222.250148:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 76 00000100:00080000:0.0:1782756222.250255:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782756222.412307:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222612480:0@lo:400:kworker.0 00000100:00100000:2.0:1782756222.412321:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869355222612352:0@lo:400:kworker.0 00010000:00010000:0.0:1782756222.412385:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756222.412428:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222612224:0@lo:400:kworker.0 00000100:00100000:0.0:1782756222.414624:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222612608:0@lo:400:kworker.0 00000100:00100000:0.0:1782756222.415803:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756222.415885:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782756222.415897:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78edbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222612992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782756222.415932:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756222.416231:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756222.416307:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222612480 00000100:00100000:0.0:1782756222.416318:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222612480 00000100:00100000:0.0:1782756222.416389:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1782756222.416399:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222612480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756222.416478:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222612480:12345-0@lo:400:kworker.0 Request processed in 79us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756222.416496:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1782756222.416525:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782756222.417464:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222612480:0@lo:400:kworker.0 00000100:00100000:2.0:1782756222.417598:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756222.417724:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c50166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222612864:0@lo:400:kworker.0 00000100:00100000:2.0:1782756222.417766:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756222.417833:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222612608 00000100:00100000:2.0:1782756222.417840:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222612608 00000100:00100000:2.0:1782756222.417891:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222612864 00000100:00100000:0.0:1782756222.417893:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222612352 00000100:00100000:2.0:1782756222.417895:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222612864 00000100:00100000:0.0:1782756222.417896:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222612352 00000100:00100000:2.0:1782756222.417923:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782756222.417928:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1782756222.417932:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ed8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222612608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756222.417933:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c50166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869355222612352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756222.417990:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c50166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869355222612352:12345-0@lo:400:kworker.0 Request processed in 56us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756222.417998:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1782756222.418604:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ed8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222612608:12345-0@lo:400:kworker.0 Request processed in 672us (2807us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756222.418613:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782756222.418629:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1782756222.418670:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c78ef1c00 x1869355222612608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756222.418687:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222612608:0@lo:400:kworker.0 00000100:00100000:2.0:1782756222.418711:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c50165180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222612864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756222.418746:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c50165180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222612864:12345-0@lo:400:kworker.0 Request processed in 39us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756222.418753:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782756222.418774:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222612992 00000100:00100000:2.0:1782756222.418778:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222612992 00000100:00100000:2.0:1782756222.418826:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782756222.418833:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ed9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222612992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782756222.418866:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782756222.418920:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ed9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222612992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (2986us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756222.418928:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1782756222.419107:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782756222.419113:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782756222.419138:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c78edbb80 x1869355222612992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782756222.419155:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78edbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222612992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782756222.419188:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869355222612352:0@lo:400:kworker.0 00010000:00080000:2.0:1782756222.419200:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c50166a00 x1869355222612864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782756222.419210:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c50166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222612864:0@lo:400:kworker.0 00000100:00100000:1.0:1782756222.419274:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756222.419323:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869355222612736:0@lo:400:kworker.0 00000100:00100000:1.0:1782756222.419356:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756222.419390:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222612736 00000100:00100000:1.0:1782756222.419395:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222612736 00000100:00100000:1.0:1782756222.419428:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1782756222.419434:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869355222612736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756222.419474:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869355222612736:12345-0@lo:400:kworker.0 Request processed in 39us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756222.419481:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1782756222.419510:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869355222612736:0@lo:400:kworker.0 00000100:00100000:2.0:1782756222.419904:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222612224 00000100:00100000:2.0:1782756222.419909:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222612224 00000100:00100000:2.0:1782756222.420771:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1782756222.420787:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3316:x1869355222612224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756222.420881:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3316:x1869355222612224:12345-0@lo:400:kworker.0 Request processed in 99us (1608us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756222.420888:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1782756222.421000:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222612224:0@lo:400:kworker.0 00000100:00080000:2.0:1782756222.421547:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1782756222.631485:0:11520:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd28ddc50 20000000:00000080:2.0:1782756222.631507:0:11520:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d3c7fa0ec00 uarg=0000000000000000 20000000:01000000:2.0:1782756222.631553:0:11520:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1782756222.631561:0:11520:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1782756222.631567:0:11520:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1782756222.632751:0:11521:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1782756222.632949:0:11520:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1782756222.638516:0:11520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1782756222.638597:0:11520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1782756222.638658:0:11520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1782756222.638678:0:11520:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1782756222.638703:0:11520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d3c4a63d400/0x5e4fb0a8aa198e0d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756222.638729:0:11520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c4a63da00/0x5e4fb0a8aa198caf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde40 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756222.638739:0:11520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c41496800/0x5e4fb0a8aa198cb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde47 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756222.638748:0:11520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c41496400/0x5e4fb0a8aa198cc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198cbd expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756222.638755:0:11520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c4a63d800/0x5e4fb0a8aa198cd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198ccb expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756222.638762:0:11520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c4b81ba00/0x5e4fb0a8aa198ce0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198cd9 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756222.638772:0:11520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d3c4a63d400/0x5e4fb0a8aa198e0d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756222.638825:0:11520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c4b81ba00/0x5e4fb0a8aa198ce0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa198cd9 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756222.638841:0:11520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d3c4b81ba00/0x5e4fb0a8aa198ce0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198cd9 expref: 18 pid: 5796 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756222.638860:0:11520:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c50166a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11520:1869355222613120:0@lo:104: 00000100:00100000:2.0:1782756222.639159:0:11520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782756222.639283:0:11520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c4a63d800/0x5e4fb0a8aa198cd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa198ccb expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756222.639293:0:11520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d3c4a63d800/0x5e4fb0a8aa198cd2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198ccb expref: 18 pid: 5797 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756222.639302:0:11520:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11520:1869355222613248:0@lo:104: 00000100:00100000:2.0:1782756222.639327:0:11520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782756222.639440:0:11520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c41496400/0x5e4fb0a8aa198cc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa198cbd expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756222.639450:0:11520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d3c41496400/0x5e4fb0a8aa198cc4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198cbd expref: 18 pid: 5796 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756222.639459:0:11520:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11520:1869355222613376:0@lo:104: 00000100:00100000:2.0:1782756222.639487:0:11520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756222.639556:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222613120 00000100:00100000:0.0:1782756222.639566:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222613120 00000100:00100000:0.0:1782756222.639625:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222613248 00000100:00100000:0.0:1782756222.639629:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222613248 00000100:00100000:0.0:1782756222.639644:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782756222.639654:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c50164380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+4:11520:x1869355222613120:12345-0@lo:104: 00010000:00010000:0.0:1782756222.639671:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: ffff9d3c4168cc00/0x5e4fb0a8aa198cd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198ce0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.639729:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782756222.639736:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c50164380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+4:11520:x1869355222613120:12345-0@lo:104: Request processed in 84us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756222.639743:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782756222.639764:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782756222.639771:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+3:11520:x1869355222613248:12345-0@lo:104: 00010000:00010000:0.0:1782756222.639779:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: ffff9d3c4168ca00/0x5e4fb0a8aa198ccb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198cd2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.639822:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782756222.639828:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+3:11520:x1869355222613248:12345-0@lo:104: Request processed in 58us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756222.639833:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1782756222.639864:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782756222.639870:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c4168cc00/0x5e4fb0a8aa198cd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198ce0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.639879:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168cc00 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:0.0:1782756222.639883:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4168cc00/0x5e4fb0a8aa198cd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa198ce0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.639895:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c4168cc00/0x5e4fb0a8aa198cd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa198ce0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782756222.639901:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4168cc00/0x5e4fb0a8aa198cd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa198ce0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782756222.639907:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782756222.640056:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c4168cc00/0x5e4fb0a8aa198cd9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198ce0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.640063:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782756222.640114:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c4168cc00/0x5e4fb0a8aa198cd9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198ce0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.640121:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c4168cc00/0x5e4fb0a8aa198cd9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198ce0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.640145:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782756222.640148:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c4168ca00/0x5e4fb0a8aa198ccb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198cd2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.640154:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168ca00 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:0.0:1782756222.640156:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4168ca00/0x5e4fb0a8aa198ccb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa198cd2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.640163:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c4168ca00/0x5e4fb0a8aa198ccb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa198cd2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782756222.640169:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4168ca00/0x5e4fb0a8aa198ccb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa198cd2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782756222.640174:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782756222.640189:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c4168ca00/0x5e4fb0a8aa198ccb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198cd2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.640194:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782756222.640209:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c4168ca00/0x5e4fb0a8aa198ccb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198cd2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.640216:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c4168ca00/0x5e4fb0a8aa198ccb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198cd2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.640225:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756222.640226:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756222.640228:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756222.640235:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782756222.640256:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782756222.640268:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78edbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0daec403-69b6-4c98-a0ea-f519ca0a480f:3314:1869355222613504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782756222.640268:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ed9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222613632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782756222.640300:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756222.640346:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222613632 00000100:00100000:0.0:1782756222.640351:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222613632 00010000:00010000:0.0:1782756222.640369:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c4a63d800/0x5e4fb0a8aa198cd2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198ccb expref: 19 pid: 5797 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756222.640392:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782756222.640398:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ed8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3316:x1869355222613632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782756222.640410:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756222.640416:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c4a63d800/0x5e4fb0a8aa198cd2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198ccb expref: 19 pid: 5797 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.640426:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c4a63d800/0x5e4fb0a8aa198cd2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198ccb expref: 19 pid: 5797 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.640443:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756222.640470:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ed8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3316:x1869355222613632:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756222.640477:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782756222.640514:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ed9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222613632:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782756222.640618:0:11520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c41496800/0x5e4fb0a8aa198cb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde47 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756222.640632:0:11520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3c41496800/0x5e4fb0a8aa198cb6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde47 expref: 12 pid: 5798 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756222.640644:0:11520:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11520:1869355222613760:192.168.204.25@tcp:104: 00000100:00100000:1.0:1782756222.641164:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222613376 00000100:00100000:1.0:1782756222.641170:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222613376 00000100:00100000:1.0:1782756222.641215:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782756222.641231:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782756222.641248:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0daec403-69b6-4c98-a0ea-f519ca0a480f+3:11520:x1869355222613376:12345-0@lo:104: 00010000:00010000:1.0:1782756222.641261:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81bc00/0x5e4fb0a8aa198cbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198cc4 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756222.641308:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782756222.641313:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0daec403-69b6-4c98-a0ea-f519ca0a480f+3:11520:x1869355222613376:12345-0@lo:104: Request processed in 67us (1826us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756222.641320:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1782756222.641582:0:11520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c4a63da00/0x5e4fb0a8aa198caf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde40 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756222.641593:0:11520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3c4a63da00/0x5e4fb0a8aa198caf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde40 expref: 12 pid: 5797 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756222.641616:0:11520:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11520:1869355222613888:192.168.204.25@tcp:104: 00000100:00100000:2.0:1782756222.641661:0:11520:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a4fa0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782756222.641682:0:11520:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c50166a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11520:1869355222613120:0@lo:104: 00010000:00010000:2.0:1782756222.641693:0:11520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4a63d800/0x5e4fb0a8aa198cd2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa198ccb expref: 18 pid: 5797 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756222.641706:0:11520:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11520:1869355222613248:0@lo:104: 00000100:00100000:2.0:1782756222.641714:0:11520:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11520:1869355222613376:0@lo:104: 00010000:00010000:0.0:1782756222.642380:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782756222.642392:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81bc00/0x5e4fb0a8aa198cbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa198cc4 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.642402:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81bc00 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:0.0:1782756222.642407:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81bc00/0x5e4fb0a8aa198cbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa198cc4 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.642432:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81bc00/0x5e4fb0a8aa198cbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa198cc4 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782756222.642440:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81bc00/0x5e4fb0a8aa198cbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa198cc4 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782756222.642446:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782756222.642484:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81bc00/0x5e4fb0a8aa198cbd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198cc4 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.642491:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782756222.642512:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81bc00/0x5e4fb0a8aa198cbd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198cc4 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.642519:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81bc00/0x5e4fb0a8aa198cbd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa198cc4 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.642537:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756222.642539:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756222.642541:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756222.642556:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ed9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222614016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782756222.642605:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756222.642655:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222614016 00000100:00100000:0.0:1782756222.642661:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222614016 00010000:00010000:0.0:1782756222.642689:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c41496400/0x5e4fb0a8aa198cc4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198cbd expref: 18 pid: 5796 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756222.642718:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782756222.642727:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78edb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:3317:x1869355222614016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782756222.642750:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756222.642756:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c41496400/0x5e4fb0a8aa198cc4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198cbd expref: 18 pid: 5796 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.642767:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c41496400/0x5e4fb0a8aa198cc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198cbd expref: 18 pid: 5796 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.642782:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c41496400/0x5e4fb0a8aa198cc4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa198cbd expref: 18 pid: 5796 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.642799:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756222.642835:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78edb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:3317:x1869355222614016:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756222.642842:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782756222.642884:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ed9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222614016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782756222.645652:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756222.645707:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210002560 00000100:00100000:0.0:1782756222.645717:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210002560 00010000:00010000:0.0:1782756222.645766:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c41496800/0x5e4fb0a8aa198cb6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde47 expref: 13 pid: 5798 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756222.645807:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 32 00000100:00100000:0.0:1782756222.645817:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ed9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2356:x1869355210002560:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782756222.645835:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756222.645842:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c41496800/0x5e4fb0a8aa198cb6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde47 expref: 13 pid: 5798 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.645854:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c41496800/0x5e4fb0a8aa198cb6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde47 expref: 13 pid: 5798 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.645892:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756222.645971:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ed9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2356:x1869355210002560:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 154us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756222.645980:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 32 00000100:00100000:3.0:1782756222.646195:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782756222.646395:0:11520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c41496800/0x5e4fb0a8aa198cb6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde47 expref: 12 pid: 5798 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756222.646414:0:11520:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11520:1869355222613760:192.168.204.25@tcp:104: 00000100:00100000:1.0:1782756222.646426:0:11520:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11520:1869355222613888:192.168.204.25@tcp:104: 00010000:00010000:1.0:1782756222.646466:0:11520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d3c4a63d400/0x5e4fb0a8aa198e0d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756222.647721:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222613504 00000100:00100000:0.0:1782756222.647736:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222613504 00010000:00010000:0.0:1782756222.647780:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c4b81ba00/0x5e4fb0a8aa198ce0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198cd9 expref: 17 pid: 5796 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756222.647821:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782756222.647831:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c501d4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:3314:x1869355222613504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782756222.647849:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756222.647855:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c4b81ba00/0x5e4fb0a8aa198ce0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198cd9 expref: 17 pid: 5796 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.647868:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c4b81ba00/0x5e4fb0a8aa198ce0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa198cd9 expref: 17 pid: 5796 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.647888:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4b81ba00/0x5e4fb0a8aa198ce0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa198cd9 expref: 17 pid: 5796 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.647905:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756222.647981:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c501d4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:3314:x1869355222613504:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (1786us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756222.647989:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782756222.648195:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756222.648375:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210002688 00000100:00100000:0.0:1782756222.648380:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210002688 00010000:00010000:0.0:1782756222.648399:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c4a63da00/0x5e4fb0a8aa198caf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde40 expref: 12 pid: 5797 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756222.648447:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 34 00000100:00100000:0.0:1782756222.648455:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77209c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+12:2355:x1869355210002688:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782756222.648466:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756222.648472:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c4a63da00/0x5e4fb0a8aa198caf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde40 expref: 12 pid: 5797 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.648484:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c4a63da00/0x5e4fb0a8aa198caf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde40 expref: 12 pid: 5797 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.648497:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4a63da00/0x5e4fb0a8aa198caf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde40 expref: 12 pid: 5797 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.648513:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d3c4a63d400/0x5e4fb0a8aa198e0d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.648523:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4a63d400/0x5e4fb0a8aa198e0d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.648541:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3c4a63d400/0x5e4fb0a8aa198e0d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.648550:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3c4a63d400/0x5e4fb0a8aa198e0d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.648558:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d3c4a63d400/0x5e4fb0a8aa198e0d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.648565:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d3c4a63d400/0x5e4fb0a8aa198e0d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.648582:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d400 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:0.0:1782756222.648587:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d3c4a63d400/0x5e4fb0a8aa198e0d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.648596:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d3c4a63d400/0x5e4fb0a8aa198e0d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.648618:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d3c4a63d400/0x5e4fb0a8aa198e0d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756222.648631:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782756222.648710:0:11520:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d3c4a63d400/0x5e4fb0a8aa198e0d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756222.648720:0:11520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d3c4a63d400/0x5e4fb0a8aa198e0d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756222.648727:0:11520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4a63d400/0x5e4fb0a8aa198e0d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756222.648863:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78edbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0daec403-69b6-4c98-a0ea-f519ca0a480f:3314:1869355222613504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782756222.650410:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77209c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+11:2355:x1869355210002688:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1945us (2207us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756222.650428:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 34 00010000:00010000:0.0:1782756223.436374:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756223.722641:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756223.722994:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210002816 00000100:00100000:3.0:1782756223.723008:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210002816 00000100:00100000:3.0:1782756223.723363:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 239 00000100:00100000:3.0:1782756223.723377:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+11:5580:x1869355210002816:12345-192.168.204.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782756223.723400:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756223.723428:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c41497200/0x5e4fb0a8aa198e14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cde94 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756223.723466:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c41497200/0x5e4fb0a8aa198e14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde94 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756223.723481:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c41497200/0x5e4fb0a8aa198e14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde94 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756223.723492:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41497200, rc 0) 00000100:00100000:3.0:1782756223.723634:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+12:5580:x1869355210002816:12345-192.168.204.25@tcp:101:ll_cfg_requeue.0 Request processed in 260us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756223.723665:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 239 00000100:00100000:2.0:1782756223.730688:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756223.730811:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210002944 00000100:00100000:0.0:1782756223.730821:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210002944 00000100:00100000:0.0:1782756223.730880:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 240 00000100:00100000:0.0:1782756223.730891:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+12:5580:x1869355210002944:12345-192.168.204.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782756223.731362:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+12:5580:x1869355210002944:12345-192.168.204.25@tcp:501:ll_cfg_requeue.0 Request processed in 471us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756223.731371:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 240 00000100:00100000:1.0:1782756223.733926:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756223.734065:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210003072 00000100:00100000:3.0:1782756223.734098:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210003072 00000100:00100000:3.0:1782756223.734200:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 241 00000100:00100000:3.0:1782756223.734209:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+12:5580:x1869355210003072:12345-192.168.204.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782756223.735089:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+12:5580:x1869355210003072:12345-192.168.204.25@tcp:503:ll_cfg_requeue.0 Request processed in 858us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756223.735099:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 241 00000100:00100000:1.0:1782756223.738560:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756223.738883:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210003200 00000100:00100000:0.0:1782756223.738893:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210003200 00000100:00100000:0.0:1782756223.739183:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 242 00000100:00100000:0.0:1782756223.739194:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+12:9927:x1869355210003200:12345-192.168.204.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782756223.739662:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+12:9927:x1869355210003200:12345-192.168.204.25@tcp:502:llog_process_th.0 Request processed in 468us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756223.739671:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 242 00000100:00100000:2.0:1782756223.742518:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756223.742599:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210003328 00000100:00100000:3.0:1782756223.742608:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210003328 00000100:00100000:3.0:1782756223.742659:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 243 00000100:00100000:3.0:1782756223.742670:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+12:9927:x1869355210003328:12345-192.168.204.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782756223.743063:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+12:9927:x1869355210003328:12345-192.168.204.25@tcp:502:llog_process_th.0 Request processed in 384us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756223.743099:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 243 00000100:00100000:1.0:1782756223.752647:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756223.752790:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210003456 00000100:00100000:0.0:1782756223.752800:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210003456 00000100:00100000:0.0:1782756223.752896:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 244 00000100:00100000:0.0:1782756223.752906:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+12:5580:x1869355210003456:12345-192.168.204.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782756223.753037:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756223.753066:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4b81bc00/0x5e4fb0a8aa198e1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cde9b expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756223.753135:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4b81bc00/0x5e4fb0a8aa198e1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde9b expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756223.753149:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4b81bc00/0x5e4fb0a8aa198e1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde9b expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756223.753160:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81bc00, rc 0) 00000100:00100000:0.0:1782756223.753223:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:5580:x1869355210003456:12345-192.168.204.25@tcp:101:ll_cfg_requeue.0 Request processed in 319us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756223.753231:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 244 00000100:00100000:0.0:1782756223.761449:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756223.761991:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210003584 00000100:00100000:1.0:1782756223.762002:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210003584 00000100:00100000:1.0:1782756223.762272:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 245 00000100:00100000:1.0:1782756223.762283:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:5580:x1869355210003584:12345-192.168.204.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782756223.762699:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:5580:x1869355210003584:12345-192.168.204.25@tcp:501:ll_cfg_requeue.0 Request processed in 416us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756223.762707:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 245 00000100:00100000:2.0:1782756223.773151:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756223.773252:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210003712 00000100:00100000:0.0:1782756223.773262:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210003712 00000100:00100000:0.0:1782756223.773325:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 246 00000100:00100000:0.0:1782756223.773336:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:5580:x1869355210003712:12345-192.168.204.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782756223.773581:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:5580:x1869355210003712:12345-192.168.204.25@tcp:503:ll_cfg_requeue.0 Request processed in 247us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756223.773590:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 246 00000100:00100000:0.0:1782756223.783399:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756223.783500:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210003840 00000100:00100000:1.0:1782756223.783510:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210003840 00000100:00100000:1.0:1782756223.783566:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 247 00000100:00100000:1.0:1782756223.783576:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:9930:x1869355210003840:12345-192.168.204.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782756223.783825:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:9930:x1869355210003840:12345-192.168.204.25@tcp:502:llog_process_th.0 Request processed in 249us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756223.783834:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 247 00000100:00100000:1.0:1782756223.786250:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756223.786415:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210003968 00000100:00100000:3.0:1782756223.786428:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210003968 00000100:00100000:3.0:1782756223.786605:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 248 00000100:00100000:3.0:1782756223.786618:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:9930:x1869355210003968:12345-192.168.204.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782756223.786980:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:9930:x1869355210003968:12345-192.168.204.25@tcp:502:llog_process_th.0 Request processed in 363us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756223.786990:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 248 10000000:01000000:0.0:1782756223.820207:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782756223.820215:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9d3c80977000 from 7 10000000:01000000:0.0:1782756223.820219:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782756223.820269:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81a400/0x5e4fb0a8aa198e22 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756223.820282:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81a400/0x5e4fb0a8aa198e22 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756223.820292:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81a400/0x5e4fb0a8aa198e22 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756223.820317:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ed8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222614144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782756223.820390:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756223.820457:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c44c34600 going to sleep for 11 seconds 00000100:00100000:2.0:1782756223.820536:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222614144 00000100:00100000:2.0:1782756223.820542:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222614144 00000100:00100000:2.0:1782756223.820587:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1782756223.820595:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:5800:x1869355222614144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782756223.820609:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756223.820621:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4a63d400/0x5e4fb0a8aa198e29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198e22 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756223.820642:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4a63d400/0x5e4fb0a8aa198e29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198e22 expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756223.820654:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4a63d400/0x5e4fb0a8aa198e29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198e22 expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756223.820663:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63d400, rc 0) 00000100:00100000:2.0:1782756223.820757:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:5800:x1869355222614144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756223.820764:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1782756223.822771:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ed8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222614144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782756223.823016:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81a400/0x5e4fb0a8aa198e22 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198e29 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756223.823114:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81a400/0x5e4fb0a8aa198e22 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198e29 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756223.823195:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ed8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222614272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782756223.823245:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756223.823305:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c44c34600 going to sleep for 11 seconds 00000100:00100000:3.0:1782756223.823409:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222614272 00000100:00100000:3.0:1782756223.823416:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222614272 00000100:00100000:3.0:1782756223.823469:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1782756223.823477:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:5800:x1869355222614272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782756223.823990:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:5800:x1869355222614272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 512us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756223.823998:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1782756223.824932:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ed8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222614272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782756223.825688:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ed8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222614400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782756223.825761:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756223.825878:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c44c34600 going to sleep for 11 seconds 00000100:00100000:1.0:1782756223.825967:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222614400 00000100:00100000:1.0:1782756223.826271:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222614400 00000100:00100000:1.0:1782756223.826522:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1782756223.826533:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:5800:x1869355222614400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782756223.826762:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:5800:x1869355222614400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 228us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756223.826769:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1782756223.826861:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ed8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222614400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782756223.831978:0:11533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7720aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:11533:1869355222614528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782756223.832108:0:11533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756223.832169:0:11533:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c455829c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782756223.832298:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222614528 00000100:00100000:3.0:1782756223.832305:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222614528 00000100:00100000:3.0:1782756223.832361:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1782756223.832371:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:11533:x1869355222614528:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782756223.832595:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:11533:x1869355222614528:12345-0@lo:502:llog_process_th.0 Request processed in 224us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756223.832602:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1782756223.833210:0:11533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7720aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:11533:1869355222614528:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782756223.833243:0:11533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782756223.833253:0:11533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782756223.833255:0:11533:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782756223.833262:0:11533:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d3c80977000 00000020:00000080:1.0:1782756223.833265:0:11533:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782756223.833357:0:11533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7720aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:11533:1869355222614656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782756223.833402:0:11533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756223.833484:0:11533:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c455829c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782756223.839994:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222614656 00000100:00100000:0.0:1782756223.840008:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222614656 00000100:00100000:0.0:1782756223.840098:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1782756223.840110:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:11533:x1869355222614656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782756223.840925:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:11533:x1869355222614656:12345-0@lo:502:llog_process_th.0 Request processed in 814us (7518us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756223.840935:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1782756223.841791:0:11533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7720aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:11533:1869355222614656:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782756223.841834:0:11533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782756223.841843:0:11533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782756223.841845:0:11533:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1782756223.841851:0:11533:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1782756223.842215:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1782756223.842237:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782756223.842248:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81a400/0x5e4fb0a8aa198e22 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198e29 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756223.842260:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81a400/0x5e4fb0a8aa198e22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198e29 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782756223.842271:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782756223.842274:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9d3c4a734800 from 7 10000000:01000000:3.0:1782756223.842276:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782756223.842307:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198e30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756223.842316:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198e30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756223.842338:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198e30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756223.842360:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222614784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782756223.842415:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756223.842447:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3b42980000 going to sleep for 11 seconds 00000100:00100000:3.0:1782756223.842462:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222614784 00000100:00100000:3.0:1782756223.842467:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222614784 00000100:00100000:3.0:1782756223.842503:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1782756223.842510:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:5800:x1869355222614784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782756223.842522:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756223.842535:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c41496400/0x5e4fb0a8aa198e37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198e30 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756223.842557:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c41496400/0x5e4fb0a8aa198e37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198e30 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756223.843065:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c41496400/0x5e4fb0a8aa198e37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198e30 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756223.843166:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41496400, rc 0) 00000100:00100000:3.0:1782756223.843264:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:5800:x1869355222614784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 753us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756223.843271:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1782756223.845536:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222614784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782756223.845624:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198e30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198e37 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756223.845638:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198e30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198e37 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756223.845713:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7720aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222614912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782756223.845767:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756223.845803:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c455829c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782756223.849141:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222614912 00000100:00100000:0.0:1782756223.849155:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222614912 00000100:00100000:0.0:1782756223.849215:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1782756223.849226:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:5800:x1869355222614912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782756223.849556:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:5800:x1869355222614912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 329us (3787us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756223.849564:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1782756223.849656:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7720aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222614912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782756223.849713:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7720aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222615040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782756223.849767:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756223.849802:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c455829c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782756223.850100:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222615040 00000100:00100000:2.0:1782756223.850106:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222615040 00000100:00100000:2.0:1782756223.850243:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1782756223.850252:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:5800:x1869355222615040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782756223.850507:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:5800:x1869355222615040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 255us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756223.850515:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1782756223.850666:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7720aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222615040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782756223.856023:0:11536:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7720aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:11536:1869355222615168:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782756223.856131:0:11536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756223.856169:0:11536:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c45582a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782756223.856272:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222615168 00000100:00100000:0.0:1782756223.856279:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222615168 00000100:00100000:0.0:1782756223.856325:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1782756223.856333:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:11536:x1869355222615168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782756223.856536:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:11536:x1869355222615168:12345-0@lo:502:llog_process_th.0 Request processed in 203us (405us total) trans 0 rc 0/0 00000040:00080000:2.0:1782756223.856543:0:11537:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1782756223.856549:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1782756223.856701:0:11536:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7720aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:11536:1869355222615168:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782756223.857040:0:11536:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782756223.857058:0:11536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782756223.857061:0:11536:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782756223.857068:0:11536:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d3c4a734800 00000020:00000080:1.0:1782756223.857071:0:11536:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782756223.857168:0:11536:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7720aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:11536:1869355222615296:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782756223.857206:0:11536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756223.857235:0:11536:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c45582a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782756223.857740:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222615296 00000100:00100000:3.0:1782756223.857747:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222615296 00000100:00100000:3.0:1782756223.857791:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1782756223.857800:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:11536:x1869355222615296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782756223.858364:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:11536:x1869355222615296:12345-0@lo:502:llog_process_th.0 Request processed in 563us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756223.858370:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1782756223.858462:0:11536:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7720aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:11536:1869355222615296:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782756223.858490:0:11536:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782756223.858496:0:11536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782756223.858498:0:11536:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1782756223.858502:0:11536:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1782756223.858632:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1782756223.858651:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782756223.858661:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198e30 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198e37 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756223.858672:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198e30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198e37 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782756223.858682:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782756223.858685:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9d3c4505a800 from 7 10000000:01000000:2.0:1782756223.858687:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782756223.858900:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63da00/0x5e4fb0a8aa198e3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756223.858981:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63da00/0x5e4fb0a8aa198e3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756223.858991:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63da00/0x5e4fb0a8aa198e3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756223.859020:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222615424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782756223.859071:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756223.859299:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a4fab40 going to sleep for 11 seconds 00000100:00100000:0.0:1782756223.859553:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222615424 00000100:00100000:0.0:1782756223.859560:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222615424 00000100:00100000:0.0:1782756223.859605:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1782756223.859615:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:5800:x1869355222615424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782756223.859627:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756223.859641:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4b81a600/0x5e4fb0a8aa198e45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa198e3e expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756223.859666:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4b81a600/0x5e4fb0a8aa198e45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198e3e expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756223.859677:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4b81a600/0x5e4fb0a8aa198e45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa198e3e expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756223.859686:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81a600, rc 0) 00000100:00100000:0.0:1782756223.861532:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:5800:x1869355222615424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1909us (2451us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756223.861545:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1782756223.863308:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222615424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782756223.863339:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63da00/0x5e4fb0a8aa198e3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198e45 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756223.863354:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63da00/0x5e4fb0a8aa198e3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198e45 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756223.863457:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7720aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222615552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782756223.863517:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756223.863565:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c45582a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782756223.863616:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222615552 00000100:00100000:2.0:1782756223.863623:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222615552 00000100:00100000:2.0:1782756223.863707:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1782756223.863722:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:5800:x1869355222615552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782756223.864210:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:5800:x1869355222615552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 494us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756223.864218:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1782756223.864836:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7720aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222615552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782756223.864878:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7720aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222615680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782756223.864920:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756223.865065:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c45582a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782756223.865200:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222615680 00000100:00100000:2.0:1782756223.865205:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222615680 00000100:00100000:2.0:1782756223.865275:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1782756223.865283:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:5800:x1869355222615680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782756223.865458:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:5800:x1869355222615680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756223.865465:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1782756223.865527:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7720aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0daec403-69b6-4c98-a0ea-f519ca0a480f:5800:1869355222615680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782756223.868029:0:11539:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:11539:1869355222615808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782756223.868351:0:11539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756223.868450:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222615808 00000100:00100000:1.0:1782756223.868457:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222615808 00000100:00100000:1.0:1782756223.868509:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1782756223.868519:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:11539:x1869355222615808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782756223.868640:0:11539:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c50115540 going to sleep for 11 seconds 00000100:00100000:1.0:1782756223.868771:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:11539:x1869355222615808:12345-0@lo:502:llog_process_th.0 Request processed in 253us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756223.868779:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1782756223.869004:0:11539:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:11539:1869355222615808:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782756223.869034:0:11539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782756223.869046:0:11539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756223.869059:0:11539:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782756223.869067:0:11539:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d3c4505a800 00000020:00000080:2.0:1782756223.869110:0:11539:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782756223.869198:0:11539:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:11539:1869355222615936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782756223.869236:0:11539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756223.869258:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222615936 00000100:00100000:2.0:1782756223.869262:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222615936 00000100:00100000:2.0:1782756223.869282:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1782756223.869289:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:11539:x1869355222615936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782756223.869407:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:11539:x1869355222615936:12345-0@lo:502:llog_process_th.0 Request processed in 117us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756223.869413:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1782756223.869445:0:11539:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c50115540 going to sleep for 11 seconds 00000100:00100000:2.0:1782756223.869457:0:11539:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0daec403-69b6-4c98-a0ea-f519ca0a480f:11539:1869355222615936:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782756223.869473:0:11539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782756223.869477:0:11539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756223.869479:0:11539:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1782756223.869483:0:11539:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1782756223.869766:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1782756223.869784:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782756223.869794:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63da00/0x5e4fb0a8aa198e3e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198e45 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756223.869805:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63da00/0x5e4fb0a8aa198e3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198e45 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782756223.989568:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1782756223.989612:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:1.0:1782756223.989664:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:3.0:1782756223.990134:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222616064:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782756223.990212:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756223.990329:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222616064 00000100:00100000:0.0:1782756223.990336:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222616064 00000100:00100000:0.0:1782756223.990390:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782756223.990399:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222616064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782756223.990424:0:6603:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1782756223.990460:0:6603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a42b37a, atime: 0x6a42b37a, ctime: 0x6a42b37a, blocks: 0x1 00010000:00010000:0.0:1782756223.990468:0:6603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa198e4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756223.990499:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=265s v=(0 0) 00010000:00010000:0.0:1782756223.990503:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782756223.990509:0:6603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa198e4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756223.990529:0:6603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa198e4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756223.990539:0:6603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa198e4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756223.990547:0:6603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa198e4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756223.990565:0:6603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782756223.991780:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1869355222616064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1378us (1565us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1782756223.991789:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1782756223.991818:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782756223.991825:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa198e4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756223.991835:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81aa00 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:0.0:1782756223.991840:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa198e4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756223.991863:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa198e4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756223.991881:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa198e4c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756223.991888:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa198e4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782756223.992026:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d3c78ed8000/2, rc 0, transno 4294967300 00000100:00100000:3.0:1782756223.992033:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222616064:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782756223.992198:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756223.992200:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756223.992202:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756224.460389:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782756224.909274:0:11537:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1782756225.486735:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756225.997822:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782756225.997845:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222616192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782756225.997915:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756225.998062:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222616192 00000100:00100000:3.0:1782756225.998070:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222616192 00000100:00100000:3.0:1782756225.998152:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782756225.998163:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78edb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1869355222616192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782756225.998199:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1782756225.998245:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782756225.998302:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78edb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1869355222616192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756225.998311:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782756225.998341:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222616192:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782756226.508308:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782756227.369187:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756227.369230:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756227.369254:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210004096 00000100:00100000:3.0:1782756227.369265:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210004096 00000100:00100000:2.0:1782756227.369270:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756227.369296:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756227.369327:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210004224 00000100:00100000:3.0:1782756227.369331:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 264 00000100:00100000:2.0:1782756227.369332:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210004224 00000100:00100000:3.0:1782756227.369347:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2357:x1869355210004096:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:2.0:1782756227.369370:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210004480 00000100:00100000:2.0:1782756227.369374:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210004480 00000100:00100000:2.0:1782756227.369395:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 80 00000100:00100000:2.0:1782756227.369403:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+5:2357:x1869355210004224:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756227.369429:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2357:x1869355210004096:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 85us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756227.369437:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 264 00000100:00100000:2.0:1782756227.369455:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+5:2357:x1869355210004224:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 51us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756227.369476:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 81 00000100:00100000:3.0:1782756227.369485:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2357:x1869355210004480:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756227.369520:0:10416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210004352 00000100:00100000:0.0:1782756227.369525:0:10416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210004352 00000100:00100000:3.0:1782756227.369526:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2357:x1869355210004480:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 41us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756227.369566:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 44 00000100:00100000:0.0:1782756227.369575:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+5:2357:x1869355210004352:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756227.369603:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+5:2357:x1869355210004352:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 31us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756227.369609:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 44 00000100:00080000:0.0:1782756227.369679:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782756227.369684:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782756227.370372:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 80 00000100:00100000:3.0:1782756227.370526:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 81 00000100:00100000:3.0:1782756227.532359:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7720aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222616320:0@lo:400:kworker.0 00000100:00100000:1.0:1782756227.532359:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c77208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869355222616448:0@lo:400:kworker.0 00010000:00010000:2.0:1782756227.532436:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782756227.532462:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7720a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222616576:0@lo:400:kworker.0 00000100:00100000:1.0:1782756227.532531:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756227.532582:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222616960:0@lo:400:kworker.0 00000100:00100000:1.0:1782756227.532611:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756227.532664:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222616448 00000100:00100000:1.0:1782756227.532672:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222616448 00000100:00100000:1.0:1782756227.532720:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1782756227.532730:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78a33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869355222616448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756227.532786:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78a33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869355222616448:12345-0@lo:400:kworker.0 Request processed in 58us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756227.532793:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1782756227.532823:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222616960 00000100:00100000:1.0:1782756227.532827:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222616960 00000100:00100000:1.0:1782756227.532864:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1782756227.532872:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78a30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222616960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756227.532904:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78a30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222616960:12345-0@lo:400:kworker.0 Request processed in 34us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756227.532911:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1782756227.532934:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782756227.532947:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c50166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222616704:0@lo:400:kworker.0 00000100:00100000:1.0:1782756227.532987:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756227.533010:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782756227.533017:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222617088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782756227.533063:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756227.533128:0:10416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222616704 00000100:00100000:1.0:1782756227.533133:0:10416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222616704 00000100:00100000:0.0:1782756227.533137:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c77208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869355222616448:0@lo:400:kworker.0 00010000:00080000:0.0:1782756227.533157:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c78a32680 x1869355222616960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756227.533167:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782756227.533172:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222616960:0@lo:400:kworker.0 00000100:00100000:1.0:1782756227.533178:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3315:x1869355222616704:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1782756227.533209:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782756227.533217:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3315:x1869355222616704:12345-0@lo:400:kworker.0 Request processed in 42us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756227.533224:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1782756227.533252:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c50166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222616704:0@lo:400:kworker.0 00000100:00100000:0.0:1782756227.533323:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222617088 00000100:00100000:0.0:1782756227.533328:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222617088 00000100:00100000:0.0:1782756227.533365:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782756227.533374:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222617088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782756227.533401:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782756227.533451:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222617088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756227.533459:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1782756227.533528:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c78ed9f80 x1869355222617088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756227.533544:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222617088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782756227.535967:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756227.536029:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c50164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869355222616832:0@lo:400:kworker.0 00000100:00100000:3.0:1782756227.536101:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756227.536251:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222616832 00000100:00100000:0.0:1782756227.536259:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222616832 00000100:00100000:0.0:1782756227.536320:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1782756227.536329:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869355222616832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756227.536383:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869355222616832:12345-0@lo:400:kworker.0 Request processed in 55us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756227.536389:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1782756227.537168:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782756227.537196:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222616320 00000100:00100000:1.0:1782756227.537203:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222616320 00000100:00100000:3.0:1782756227.537209:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c50164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869355222616832:0@lo:400:kworker.0 00000100:00100000:1.0:1782756227.537244:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1782756227.537343:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3316:x1869355222616320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756227.537358:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756227.537390:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3316:x1869355222616320:12345-0@lo:400:kworker.0 Request processed in 49us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756227.537502:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7720aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222616320:0@lo:400:kworker.0 00000100:00100000:0.0:1782756227.537520:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222616576 00000100:00100000:0.0:1782756227.537524:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222616576 00000100:00100000:0.0:1782756227.537570:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1782756227.537578:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222616576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756227.537613:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222616576:12345-0@lo:400:kworker.0 Request processed in 37us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756227.537633:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1782756227.537842:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:2.0:1782756227.537877:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782756227.537898:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7720a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222616576:0@lo:400:kworker.0 00010000:00010000:0.0:1782756228.556365:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782756229.108147:0:6627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:2.0:1782756229.580388:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756230.613860:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782756231.117412:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782756231.117435:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222617216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782756231.117508:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756231.117676:0:8071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222617216 00000100:00100000:0.0:1782756231.117684:0:8071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222617216 00000100:00100000:0.0:1782756231.117747:0:8071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1782756231.117761:0:8071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222617216:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782756231.117769:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1782756231.117798:0:8071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782756231.117847:0:8071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222617216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756231.117855:0:8071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782756231.117884:0:3314:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1782756231.117891:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d3c78ed8000, transno 4294967300 00000100:00100000:2.0:1782756231.117932:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222617216:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782756231.628277:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756232.492548:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756232.492598:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756232.492633:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756232.492689:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756232.492702:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210004736 00000100:00100000:3.0:1782756232.492712:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210004736 00000100:00100000:0.0:1782756232.492733:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210004992 00000100:00100000:0.0:1782756232.492747:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210004992 00000100:00100000:3.0:1782756232.492776:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 85 00000100:00100000:0.0:1782756232.492783:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 86 00000100:00100000:3.0:1782756232.492785:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78edaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+5:2355:x1869355210004736:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756232.492789:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2355:x1869355210004992:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:2.0:1782756232.492861:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210004608 00000100:00100000:2.0:1782756232.492866:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210004608 00000100:00100000:3.0:1782756232.492873:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78edaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+5:2355:x1869355210004736:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 87us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756232.492879:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210004864 00000100:00100000:1.0:1782756232.492896:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210004864 00000100:00100000:2.0:1782756232.492915:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 266 00000100:00100000:2.0:1782756232.492926:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2355:x1869355210004608:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1782756232.492938:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 47 00000100:00100000:1.0:1782756232.492947:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ed8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+5:2355:x1869355210004864:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756232.492999:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2355:x1869355210004992:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 209us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756232.493008:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2355:x1869355210004608:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 82us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756232.493016:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 266 00000100:00100000:1.0:1782756232.493036:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ed8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+5:2355:x1869355210004864:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 89us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756232.493061:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 47 00000100:00080000:1.0:1782756232.493154:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782756232.493159:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782756232.493400:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 85 00000100:00100000:0.0:1782756232.493697:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 86 00000100:00100000:1.0:1782756232.652287:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782756232.652310:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222617344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782756232.652431:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756232.652499:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222617472:0@lo:400:kworker.0 00000100:00100000:3.0:1782756232.652514:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222617856:0@lo:400:kworker.0 00000100:00100000:1.0:1782756232.652532:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756232.652559:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756232.652559:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869355222617600:0@lo:400:kworker.0 00000100:00100000:1.0:1782756232.652590:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869355222617984:0@lo:400:kworker.0 00000100:00100000:2.0:1782756232.652602:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756232.652614:0:10416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222617856 00000100:00100000:3.0:1782756232.652620:0:10416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222617856 00000100:00100000:1.0:1782756232.652623:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756232.652626:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222618112:0@lo:400:kworker.0 00000100:00100000:2.0:1782756232.652656:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756232.652668:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222617600 00000100:00100000:1.0:1782756232.652673:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222617600 00000100:00100000:2.0:1782756232.652681:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782756232.652682:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222618112 00000100:00100000:0.0:1782756232.652687:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222618112 00000100:00100000:2.0:1782756232.652691:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222617728:0@lo:400:kworker.0 00000100:00100000:1.0:1782756232.652704:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222617984 00000100:00100000:1.0:1782756232.652708:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222617984 00000100:00100000:2.0:1782756232.652723:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756232.652733:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222617728 00000100:00100000:1.0:1782756232.652737:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222617728 00000100:00100000:1.0:1782756232.652771:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782756232.652778:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222617344 00000100:00100000:1.0:1782756232.652782:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c809f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869355222617600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756232.652785:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222617344 00000100:00100000:0.0:1782756232.652788:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782756232.652798:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222617856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756232.652837:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782756232.652847:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1869355222617344:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782756232.652889:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c809f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869355222617600:12345-0@lo:400:kworker.0 Request processed in 99us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756232.652889:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222617856:12345-0@lo:400:kworker.0 Request processed in 82us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756232.652898:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1782756232.652898:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782756232.652915:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1782756232.652921:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c809f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1869355222618112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756232.652942:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782756232.652949:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869355222617984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756232.652949:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c809f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1869355222618112:12345-0@lo:400:kworker.0 Request processed in 29us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756232.652955:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1782756232.652976:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782756232.652980:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869355222617984:12345-0@lo:400:kworker.0 Request processed in 32us (359us total) trans 0 rc 0/0 00000100:00080000:0.0:1782756232.652981:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782756232.652986:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00010000:0.0:1782756232.652989:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756232.653015:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222617856:0@lo:400:kworker.0 00000100:00100000:1.0:1782756232.653018:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782756232.653023:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4b607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222617728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756232.653062:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4b607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222617728:12345-0@lo:400:kworker.0 Request processed in 39us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756232.653068:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782756232.653121:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222617728:0@lo:400:kworker.0 00000100:00100000:1.0:1782756232.653132:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869355222617600:0@lo:400:kworker.0 00010000:00080000:1.0:1782756232.653143:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c809f5f80 x1869355222618112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756232.653154:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222618112:0@lo:400:kworker.0 00000100:00100000:1.0:1782756232.653202:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869355222617984:0@lo:400:kworker.0 00002000:00000024:2.0:1782756232.653312:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782756232.653886:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222617344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1031us (1463us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756232.653898:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782756232.653922:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222617472 00000100:00100000:2.0:1782756232.653943:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222617472 00000100:00100000:2.0:1782756232.653969:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1782756232.653975:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3317:x1869355222617472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756232.654006:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3317:x1869355222617472:12345-0@lo:400:kworker.0 Request processed in 31us (1476us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756232.654012:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1782756232.654150:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222617472:0@lo:400:kworker.0 00010000:00080000:1.0:1782756232.654163:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c76fd3100 x1869355222617344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756232.654177:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222617344:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782756233.676424:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782756234.125048:0:11537:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1782756234.700595:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756235.725317:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782756236.241872:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222618240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782756236.241977:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756236.243704:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222618240 00000100:00100000:3.0:1782756236.243728:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222618240 00000100:00100000:3.0:1782756236.243887:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782756236.243918:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4b604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222618240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782756236.243980:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782756236.244061:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4b604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222618240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (2083us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756236.244068:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782756236.244155:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222618240:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782756236.244294:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782756236.748302:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756237.611923:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756237.612012:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756237.612040:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756237.612107:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210005376 00000100:00100000:0.0:1782756237.612118:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210005376 00000100:00100000:1.0:1782756237.612160:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756237.612189:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210005248 00000100:00100000:1.0:1782756237.612193:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210005248 00000100:00100000:0.0:1782756237.612205:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 50 00000100:00100000:0.0:1782756237.612220:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+5:2357:x1869355210005376:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1782756237.612226:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210005504 00000100:00100000:1.0:1782756237.612231:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210005504 00000100:00100000:1.0:1782756237.612255:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 90 00000100:00100000:1.0:1782756237.612278:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+5:2357:x1869355210005248:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756237.612322:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+5:2357:x1869355210005376:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 106us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756237.612331:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 50 00000100:00100000:2.0:1782756237.612382:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 91 00000100:00100000:2.0:1782756237.612393:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2358:x1869355210005504:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756237.613379:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210005120 00000100:00100000:3.0:1782756237.613388:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210005120 00000100:00100000:3.0:1782756237.613431:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 268 00000100:00100000:3.0:1782756237.613439:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2357:x1869355210005120:12345-192.168.204.25@tcp:400:kworker.0 00000100:00080000:0.0:1782756237.613647:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782756237.613652:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782756237.620295:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2358:x1869355210005504:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 7889us (8119us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756237.620313:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 91 00000100:00100000:3.0:1782756237.620721:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2357:x1869355210005120:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 7280us (8805us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756237.620731:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 268 00000100:00100000:1.0:1782756237.621200:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+5:2357:x1869355210005248:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 8922us (9156us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756237.621209:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 90 00000100:00100000:0.0:1782756237.772739:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869355222618496:0@lo:400:kworker.0 00000100:00100000:0.0:1782756237.772829:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756237.772900:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782756237.772906:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222618368:0@lo:400:kworker.0 00000100:00100000:0.0:1782756237.772931:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756237.772950:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c50166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869355222618880:0@lo:400:kworker.0 00000100:00100000:0.0:1782756237.772971:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756237.773014:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222618496 00000100:00100000:0.0:1782756237.773022:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222618496 00000100:00100000:0.0:1782756237.773062:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222618880 00000100:00100000:0.0:1782756237.773065:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222618880 00000100:00100000:0.0:1782756237.773116:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782756237.773124:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78edbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869355222618496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756237.773173:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78edbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869355222618496:12345-0@lo:400:kworker.0 Request processed in 50us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756237.773180:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782756237.773201:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1782756237.773207:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c809f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869355222618880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756237.773233:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c809f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869355222618880:12345-0@lo:400:kworker.0 Request processed in 27us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756237.773238:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1782756237.773257:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222618624:0@lo:400:kworker.0 00000100:00100000:0.0:1782756237.773276:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756237.773291:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782756237.773295:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c50164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222618752:0@lo:400:kworker.0 00000100:00100000:0.0:1782756237.773314:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782756237.773335:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782756237.773342:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222618624 00000100:00100000:0.0:1782756237.773345:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222618624 00000100:00100000:0.0:1782756237.773377:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1782756237.773383:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c809f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222618624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756237.773424:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c809f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222618624:12345-0@lo:400:kworker.0 Request processed in 41us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756237.773430:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1782756237.773444:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782756237.773469:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222618624:0@lo:400:kworker.0 00000100:00100000:0.0:1782756237.773498:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c50166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869355222618880:0@lo:400:kworker.0 00000100:00100000:0.0:1782756237.773507:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869355222618496:0@lo:400:kworker.0 00000100:00100000:0.0:1782756237.773998:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222618752 00000100:00100000:0.0:1782756237.774003:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222618752 00000100:00100000:0.0:1782756237.774030:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782756237.774037:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c809f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222618752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756237.774094:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c809f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222618752:12345-0@lo:400:kworker.0 Request processed in 37us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756237.774100:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782756237.774124:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c50164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222618752:0@lo:400:kworker.0 00000100:00100000:2.0:1782756237.774614:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222618368 00000100:00100000:2.0:1782756237.774619:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222618368 00000100:00100000:2.0:1782756237.774657:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1782756237.774665:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3317:x1869355222618368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756237.774702:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3317:x1869355222618368:12345-0@lo:400:kworker.0 Request processed in 38us (1769us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756237.774708:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1782756237.774937:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782756237.774947:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222619136:0@lo:400:kworker.0 00000100:00100000:1.0:1782756237.774995:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756237.775026:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222619136 00000100:00100000:1.0:1782756237.775029:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222619136 00000100:00100000:1.0:1782756237.775061:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1782756237.775068:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222619136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756237.775115:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222619136:12345-0@lo:400:kworker.0 Request processed in 48us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756237.775122:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1782756237.775150:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c80fcea00 x1869355222619136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756237.775162:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222619136:0@lo:400:kworker.0 00000100:00080000:1.0:1782756237.775181:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782756237.775364:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782756237.775375:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222619008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782756237.775413:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756237.775516:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222619008 00000100:00100000:2.0:1782756237.775520:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222619008 00000100:00100000:2.0:1782756237.775549:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782756237.775556:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222619008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782756237.775581:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782756237.775614:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222619008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756237.775619:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782756237.778555:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222618368:0@lo:400:kworker.0 00010000:00080000:3.0:1782756237.779385:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c4b607100 x1869355222619008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756237.779408:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222619008:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782756237.779769:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756238.796282:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756239.820280:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756240.844387:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782756241.357271:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782756241.357296:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222619264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782756241.357370:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756241.357578:0:8071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222619264 00000100:00100000:0.0:1782756241.357587:0:8071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222619264 00000100:00100000:0.0:1782756241.357652:0:8071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782756241.357663:0:8071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4b606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222619264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782756241.357697:0:8071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782756241.357749:0:8071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4b606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222619264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756241.357770:0:8071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1782756241.357986:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782756241.358021:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222619264:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782756241.868288:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756242.730761:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756242.730817:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756242.730934:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210005632 00000100:00100000:3.0:1782756242.730948:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210005632 00000100:00100000:3.0:1782756242.731027:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 270 00000100:00100000:3.0:1782756242.731039:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2357:x1869355210005632:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756242.731197:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2357:x1869355210005632:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 160us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756242.731227:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 270 00000100:00100000:0.0:1782756242.731340:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210005760 00000100:00100000:0.0:1782756242.731345:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210005760 00000100:00100000:0.0:1782756242.731408:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 95 00000100:00080000:2.0:1782756242.731414:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782756242.731424:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+5:2357:x1869355210005760:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756242.731470:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+5:2357:x1869355210005760:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 54us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756242.731478:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 95 00000100:00100000:0.0:1782756242.741953:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756242.742121:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756242.742219:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210006016 00000100:00100000:3.0:1782756242.742233:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210006016 00000100:00100000:3.0:1782756242.742323:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 96 00000100:00100000:3.0:1782756242.742334:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c50166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2356:x1869355210006016:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756242.742432:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c50166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2356:x1869355210006016:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 100us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756242.742440:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 96 00000100:00080000:0.0:1782756242.742737:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782756242.742939:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210005888 00000100:00100000:1.0:1782756242.742945:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210005888 00000100:00080000:0.0:1782756242.743032:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782756242.743145:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19 00000100:00100000:1.0:1782756242.743154:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c50164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+5:2354:x1869355210005888:12345-192.168.204.25@tcp:9:kworker.0 00000020:00000080:1.0:1782756242.743199:0:6602:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa198d88 00000100:00080000:1.0:1782756242.743210:0:6602:0:(import.c:65:import_set_state_nolock()) ffff9d3c77037000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782756242.743259:0:6602:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:3.0:1782756242.744111:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756242.748615:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c50164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+2:2354:x1869355210005888:12345-192.168.204.25@tcp:9:kworker.0 Request processed in 5448us (6664us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756242.748629:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19 00010000:00010000:3.0:1782756242.892593:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756242.892813:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782756242.892838:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222619392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782756242.892988:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756242.893449:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222619392 00000100:00100000:3.0:1782756242.893458:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222619392 00000100:00100000:3.0:1782756242.893518:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782756242.893527:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222619392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782756242.893560:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782756242.893732:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222619392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 199us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756242.893739:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1782756242.893766:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1782756242.893797:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c80fced80 x1869355222619392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756242.893813:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222619392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782756242.894071:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869355222619648:0@lo:400:kworker.0 00000100:00100000:2.0:1782756242.894170:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756242.894204:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782756242.894217:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222619776:0@lo:400:kworker.0 00000100:00100000:2.0:1782756242.894247:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756242.894282:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222619648 00000100:00100000:2.0:1782756242.894291:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222619648 00000100:00100000:2.0:1782756242.894315:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222619776 00000100:00100000:2.0:1782756242.894317:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222619776 00000100:00100000:2.0:1782756242.894335:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1782756242.894342:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4b607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869355222619648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756242.894380:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4b607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869355222619648:12345-0@lo:400:kworker.0 Request processed in 39us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756242.894387:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1782756242.894399:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1782756242.894405:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4b607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222619776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756242.894430:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4b607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222619776:12345-0@lo:400:kworker.0 Request processed in 26us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756242.894436:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1782756242.894461:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222619776:0@lo:400:kworker.0 00000100:00100000:2.0:1782756242.894470:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869355222619648:0@lo:400:kworker.0 00000100:00080000:3.0:1782756242.894542:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782756242.894552:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222619520:0@lo:400:kworker.0 00000100:00100000:3.0:1782756242.894582:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756242.894991:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222619904:0@lo:400:kworker.0 00000100:00100000:1.0:1782756242.895023:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756242.895055:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222619904 00000100:00100000:1.0:1782756242.895059:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222619904 00000100:00100000:1.0:1782756242.895111:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782756242.895119:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222619904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756242.895158:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222619904:12345-0@lo:400:kworker.0 Request processed in 40us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756242.895165:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782756242.895183:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222619904:0@lo:400:kworker.0 00000100:00100000:2.0:1782756242.895240:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222619520 00000100:00100000:2.0:1782756242.895245:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222619520 00000100:00100000:2.0:1782756242.895269:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1782756242.895275:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3317:x1869355222619520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756242.895308:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3317:x1869355222619520:12345-0@lo:400:kworker.0 Request processed in 33us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756242.895322:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1782756242.895641:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869355222620032:0@lo:400:kworker.0 00000100:00100000:3.0:1782756242.895671:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756242.895710:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222619520:0@lo:400:kworker.0 00000100:00100000:2.0:1782756242.895819:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222620032 00000100:00100000:2.0:1782756242.895823:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222620032 00000100:00100000:2.0:1782756242.895935:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1782756242.895942:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869355222620032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756242.895978:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869355222620032:12345-0@lo:400:kworker.0 Request processed in 37us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756242.895984:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1782756242.896037:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782756242.896056:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869355222620032:0@lo:400:kworker.0 00010000:00010000:3.0:1782756243.916479:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782756244.367613:0:11537:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:0.0:1782756244.495929:0:6627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 26487635-60cb-4aee-af8e-396654f6c3d8 00000020:00000080:0.0:1782756244.495940:0:6627:0:(genops.c:906:class_export_put()) final put ffff9d3c7b93e000/26487635-60cb-4aee-af8e-396654f6c3d8 00000020:00000080:2.0:1782756244.496032:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c7b93e000/26487635-60cb-4aee-af8e-396654f6c3d8 for lustre-OST0000 00000020:00000080:2.0:1782756244.496114:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d3c77037000 for lustre-OST0000 00010000:00010000:3.0:1782756244.941164:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756245.965601:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782756246.251608:0:11701:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 14:04:04 (1782756244) 00000100:00100000:0.0:1782756246.476551:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782756246.476587:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222620160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782756246.476679:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756246.476805:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222620160 00000100:00100000:3.0:1782756246.476815:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222620160 00000100:00100000:3.0:1782756246.476947:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782756246.476957:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222620160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782756246.476992:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782756246.477054:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222620160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756246.477062:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1782756246.477589:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782756246.477879:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222620160:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782756246.989089:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756247.684364:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756247.684509:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210006144 00000100:00100000:3.0:1782756247.684519:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210006144 00000100:00100000:3.0:1782756247.684606:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 32 00000100:00100000:3.0:1782756247.684618:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+5:10198:x1869355210006144:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782756247.684640:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756247.684718:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa198e53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdea2 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756247.684796:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa198e5a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756247.684830:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa198e5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782756247.684939:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782756247.685115:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa198e5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782756247.685312:0:6579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782756247.685317:0:6579:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1782756247.685423:0:6579:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa198e5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756247.685450:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa198e53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdea2 expref: 7 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756247.685469:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa198e5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdea2 expref: 6 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756247.685478:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c49e15e00) 00010000:00010000:3.0:1782756247.685481:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782756247.685484:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41497e00, rc 0) 00000100:00100000:3.0:1782756247.685547:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+6:10198:x1869355210006144:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 932us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756247.685555:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 32 00000100:00100000:0.0:1782756247.695147:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756247.695244:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210006272 00000100:00100000:2.0:1782756247.695258:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210006272 00000100:00100000:2.0:1782756247.695324:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 33 00000100:00100000:2.0:1782756247.695334:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+6:10199:x1869355210006272:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782756247.695358:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756247.695380:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63ca00/0x5e4fb0a8aa198e61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdea9 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756247.695453:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa198e68 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756247.695469:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa198e68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756247.695501:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa198e68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756247.695517:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa198e6f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756247.695526:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa198e6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756247.695532:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa198e6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756247.695960:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa198e76 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756247.695969:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa198e76 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756247.695977:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa198e76 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756247.696056:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1782756247.696060:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1782756247.696160:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa198e76 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756247.696172:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa198e68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756247.696178:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa198e68 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756247.696194:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa198e68 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756247.696199:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63c000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756247.696203:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa198e68 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756247.696211:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa198e68 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756247.696223:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c49e15e00) 00010000:00010000:2.0:1782756247.696226:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756247.696231:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa198e68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756247.696237:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa198e68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756247.696249:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa198e6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756247.696255:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa198e6f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756247.696261:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa198e6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756247.696266:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63c800 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756247.696269:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa198e6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756247.696286:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa198e6f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756247.696295:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9d3c58212500) 00010000:00010000:2.0:1782756247.696297:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756247.696300:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa198e6f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756247.696306:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa198e6f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756247.696337:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63ca00/0x5e4fb0a8aa198e61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdea9 expref: 8 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756247.696350:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa198e76 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdea9 expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756247.696355:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d3c58212100) 00010000:00010000:2.0:1782756247.696357:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782756247.696359:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63c600, rc 0) 00000100:00100000:2.0:1782756247.696421:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+7:10199:x1869355210006272:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 1088us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756247.696429:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 33 00000100:00100000:1.0:1782756247.699438:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756247.699576:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210006528 00000100:00100000:0.0:1782756247.699596:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210006528 00000100:00100000:0.0:1782756247.699656:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 34 00000100:00100000:0.0:1782756247.699667:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+7:10199:x1869355210006528:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782756247.699690:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756247.699725:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198e7d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdeb0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756247.699807:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198e84 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756247.699822:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198e84 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756247.699834:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198e84 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756247.699875:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198e8b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756247.699883:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198e8b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756247.699889:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198e8b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756247.700828:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ba00/0x5e4fb0a8aa198e92 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756247.700840:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ba00/0x5e4fb0a8aa198e92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756247.700848:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ba00/0x5e4fb0a8aa198e92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782756247.700857:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1782756247.701068:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198e84 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756247.701103:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198e84 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756247.701110:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198e84 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756247.701115:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81aa00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756247.701119:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198e84 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756247.701126:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198e84 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756247.701139:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d3c58212100) 00010000:00010000:0.0:1782756247.701142:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756247.701146:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198e84 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756247.701151:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198e84 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756247.701164:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198e8b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756247.701169:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198e8b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756247.701174:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198e8b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756247.701179:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81be00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756247.701187:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198e8b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756247.701193:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198e8b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756247.701200:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9d3c54288a00) 00010000:00010000:0.0:1782756247.701202:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756247.701205:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198e8b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756247.701210:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198e8b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756247.701568:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198e7d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdeb0 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756247.701596:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ba00/0x5e4fb0a8aa198e92 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdeb0 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756247.701603:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3c54288100) 00010000:00010000:0.0:1782756247.701605:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756247.701608:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81ba00, rc 0) 00000100:00100000:0.0:1782756247.701669:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+9:10199:x1869355210006528:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 2004us (2238us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1782756247.701677:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 34 00000100:00100000:1.0:1782756247.717677:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756247.717758:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210006656 00000100:00100000:0.0:1782756247.717769:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210006656 00000100:00100000:0.0:1782756247.717830:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 35 00000100:00100000:0.0:1782756247.717850:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+9:10199:x1869355210006656:12345-192.168.204.25@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1782756247.717972:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+9:10199:x1869355210006656:12345-192.168.204.25@tcp:59:lhsmtool_posix.0 Request processed in 132us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756247.717979:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 35 00000100:00100000:0.0:1782756247.850757:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756247.852947:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756247.853034:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210006912 00000100:00100000:3.0:1782756247.853048:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210006912 00000100:00100000:3.0:1782756247.853181:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 100 00000100:00100000:1.0:1782756247.853193:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210006784 00000100:00100000:3.0:1782756247.853194:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2358:x1869355210006912:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1782756247.853201:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210006784 00000100:00100000:1.0:1782756247.853245:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 272 00000100:00100000:1.0:1782756247.853255:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2358:x1869355210006784:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756247.853317:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2358:x1869355210006912:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 122us (2571us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756247.853318:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2358:x1869355210006784:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 60us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756247.853330:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 272 00000100:00100000:3.0:1782756247.853335:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 100 00000100:00080000:0.0:1782756247.853938:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782756248.017498:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756248.017624:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c77000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222620416:0@lo:400:kworker.0 00000100:00100000:1.0:1782756248.017696:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756248.017766:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222620416 00000100:00100000:1.0:1782756248.017773:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222620416 00000100:00100000:1.0:1782756248.017817:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1782756248.017827:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3316:x1869355222620416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756248.017884:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3316:x1869355222620416:12345-0@lo:400:kworker.0 Request processed in 59us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756248.017892:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1782756248.017941:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c77000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222620416:0@lo:400:kworker.0 00000100:00100000:1.0:1782756248.017977:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c77000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869355222620544:0@lo:400:kworker.0 00000100:00100000:1.0:1782756248.018006:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756248.018038:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222620544 00000100:00100000:1.0:1782756248.018042:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222620544 00000100:00100000:1.0:1782756248.018070:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1782756248.018103:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77001880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869355222620544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756248.018140:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77001880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869355222620544:12345-0@lo:400:kworker.0 Request processed in 39us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756248.018147:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1782756248.018177:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c77000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869355222620544:0@lo:400:kworker.0 00000100:00100000:1.0:1782756248.018239:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c77001c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869355222620928:0@lo:400:kworker.0 00000100:00100000:1.0:1782756248.018263:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756248.018293:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222620928 00000100:00100000:1.0:1782756248.018297:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222620928 00000100:00100000:1.0:1782756248.018329:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1782756248.018335:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869355222620928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756248.018367:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869355222620928:12345-0@lo:400:kworker.0 Request processed in 32us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756248.018373:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1782756248.018397:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c77001c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869355222620928:0@lo:400:kworker.0 00000100:00080000:1.0:1782756248.018411:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782756248.018434:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c77001c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222621056:0@lo:400:kworker.0 00000100:00100000:1.0:1782756248.018460:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756248.018487:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222621056 00000100:00100000:1.0:1782756248.018490:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222621056 00000100:00100000:1.0:1782756248.018515:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782756248.018521:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77000700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222621056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756248.018555:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77000700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222621056:12345-0@lo:400:kworker.0 Request processed in 34us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756248.018561:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1782756248.018599:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c77001c00 x1869355222621056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782756264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756248.018610:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c77001c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222621056:0@lo:400:kworker.0 00000100:00080000:1.0:1782756248.018623:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782756248.018867:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c77000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222620672:0@lo:400:kworker.0 00000100:00100000:3.0:1782756248.018899:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756248.018924:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782756248.018930:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c77001180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222620288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782756248.018951:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756248.018966:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c77003b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222620800:0@lo:400:kworker.0 00000100:00100000:3.0:1782756248.018983:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756248.019014:0:8071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222620288 00000100:00100000:3.0:1782756248.019017:0:8071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222620288 00000100:00100000:3.0:1782756248.019042:0:8071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782756248.019049:0:8071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222620288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782756248.019097:0:8071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782756248.019133:0:8071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222620288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756248.019139:0:8071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1782756248.019167:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c77001180 x1869355222620288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756248.019181:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c77001180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222620288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782756248.024839:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222620672 00000100:00100000:1.0:1782756248.024873:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222620672 00000100:00100000:1.0:1782756248.024958:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1782756248.024969:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222620672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756248.025072:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222620672:12345-0@lo:400:kworker.0 Request processed in 104us (6171us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756248.025094:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1782756248.025122:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222620800 00000100:00100000:1.0:1782756248.025126:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222620800 00000100:00100000:1.0:1782756248.025154:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782756248.025160:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222620800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756248.025191:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222620800:12345-0@lo:400:kworker.0 Request processed in 32us (6207us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756248.025197:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782756248.025242:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c77003b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222620800:0@lo:400:kworker.0 00000100:00100000:1.0:1782756248.025257:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c77000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222620672:0@lo:400:kworker.0 00000100:00080000:3.0:1782756248.025338:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782756248.025343:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1782756248.460740:0:11537:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782756249.036396:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756249.352803:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756249.354876:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210007040 00000100:00100000:2.0:1782756249.354889:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210007040 00000100:00100000:2.0:1782756249.355006:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 36 00000100:00100000:2.0:1782756249.355016:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77000000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+9:10241:x1869355210007040:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1782756249.355048:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756249.355068:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa198ea0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdeb7 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782756249.355233:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782756249.355287:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa198ea7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.355302:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa198ea7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.355314:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa198ea7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.355328:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa198eae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.355335:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa198eae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.355343:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa198eae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.355600:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa198ea7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.355608:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa198ea7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.355614:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa198ea7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.355620:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756249.355628:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa198ea7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.355636:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa198ea7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.355647:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c49e15e00) 00010000:00010000:2.0:1782756249.355650:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756249.355653:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa198ea7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.355659:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa198ea7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.355669:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa198eae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.355675:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa198eae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.355681:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa198eae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.355685:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756249.355687:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa198eae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.355692:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa198eae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.355697:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d3c58212500) 00010000:00010000:2.0:1782756249.355698:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756249.355704:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa198eae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.355710:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa198eae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.355739:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa198ea0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdeb7 expref: 10 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.355749:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c49e15e00) 00010000:00010000:2.0:1782756249.355752:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756249.355755:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa198ea0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdeb7 expref: 10 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.355765:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63d800, rc 0) 00000100:00100000:2.0:1782756249.355843:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77000000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+9:10241:x1869355210007040:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 829us (3049us total) trans 0 rc 301/301 00000100:00100000:2.0:1782756249.355850:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 36 00000100:00100000:2.0:1782756249.363656:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756249.363836:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210007296 00000100:00100000:0.0:1782756249.363848:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210007296 00000100:00100000:0.0:1782756249.363929:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 37 00000100:00100000:0.0:1782756249.363941:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4b606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+9:10241:x1869355210007296:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:0.0:1782756249.364010:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756249.364042:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa198e5a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdea2 expref: 9 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.364061:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c49e15e00) 00010000:00010000:0.0:1782756249.365242:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782756249.365542:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198eb5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.365569:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198eb5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.365579:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198eb5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.365591:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198ebc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.365607:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198ebc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.365614:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198ebc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782756249.368753:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1782756249.368772:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198eb5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.368782:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198eb5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.368790:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198eb5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.368796:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81be00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756249.368800:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198eb5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.368807:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198eb5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.368823:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c54288a00) 00010000:00010000:0.0:1782756249.368826:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756249.368831:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198eb5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.368837:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198eb5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782756249.368866:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b0efb91b reply state 00000000400f1a15 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198ebc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756249.368875:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782756249.368985:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4b606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+10:10241:x1869355210007296:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 5043us (5335us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1782756249.368995:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 37 00010000:00010000:3.0:1782756249.374033:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198ebc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756249.374048:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198ebc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756249.374064:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198ebc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756249.374071:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81aa00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756249.379436:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198ebc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756249.379458:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198ebc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756249.379486:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d3c54288000) 00010000:00010000:3.0:1782756249.379491:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756249.379498:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198ebc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756249.379506:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198ebc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756249.498324:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756249.498818:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210007424 00000100:00100000:1.0:1782756249.498831:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210007424 00000100:00100000:1.0:1782756249.498960:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 38 00000100:00100000:1.0:1782756249.498971:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4b606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+9:10250:x1869355210007424:12345-192.168.204.25@tcp:101:lctl.0 00010000:00010000:1.0:1782756249.498995:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756249.499033:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa198ec3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdebe expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.499274:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4a00/0x5e4fb0a8aa198eca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.499302:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4a00/0x5e4fb0a8aa198eca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.499314:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4a00/0x5e4fb0a8aa198eca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756249.499378:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782756249.499382:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1782756249.499435:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4a00/0x5e4fb0a8aa198eca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.499462:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa198ec3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdebe expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.499482:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4a00/0x5e4fb0a8aa198eca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdebe expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.499491:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c4ef38400) 00010000:00010000:1.0:1782756249.499493:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782756249.499497:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef4a00, rc 0) 00000100:00100000:1.0:1782756249.499578:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4b606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+10:10250:x1869355210007424:12345-192.168.204.25@tcp:101:lctl.0 Request processed in 609us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756249.499586:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 38 00000100:00100000:0.0:1782756249.553101:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756249.554890:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210007552 00000100:00100000:2.0:1782756249.554903:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210007552 00000100:00100000:2.0:1782756249.554958:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 39 00000100:00100000:2.0:1782756249.554968:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7720a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+10:10256:x1869355210007552:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:2.0:1782756249.554990:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756249.555010:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa198ed1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdec5 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.555100:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa198ed8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.555121:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa198ed8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.555133:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa198ed8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.555147:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa198edf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.555154:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa198edf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.555160:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa198edf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.555507:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c200/0x5e4fb0a8aa198ee6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.555516:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c200/0x5e4fb0a8aa198ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.555525:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c200/0x5e4fb0a8aa198ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756249.555623:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1782756249.555628:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782756249.555716:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c200/0x5e4fb0a8aa198ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.555729:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa198ed8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.555744:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa198ed8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.555750:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa198ed8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.555756:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756249.555760:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa198ed8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.555768:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa198ed8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.555780:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c4ef38400) 00010000:00010000:2.0:1782756249.555783:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756249.555787:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa198ed8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.555793:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa198ed8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.555807:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa198edf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.555813:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa198edf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.555819:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa198edf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.555824:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756249.555832:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa198edf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.555839:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa198edf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.555846:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d3c58212600) 00010000:00010000:2.0:1782756249.555849:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756249.555852:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa198edf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.555858:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa198edf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.555888:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa198ed1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdec5 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.555902:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c200/0x5e4fb0a8aa198ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdec5 expref: 11 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.555908:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:2.0:1782756249.555910:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782756249.555913:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63c200, rc 0) 00000100:00100000:2.0:1782756249.555979:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7720a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+11:10256:x1869355210007552:12345-192.168.204.25@tcp:101:bash.0 Request processed in 1013us (2904us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756249.555987:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 39 00000100:00100000:1.0:1782756249.564185:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756249.565232:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210007808 00000100:00100000:0.0:1782756249.565244:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210007808 00000100:00100000:0.0:1782756249.565307:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 40 00000100:00100000:0.0:1782756249.565317:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77003b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+11:10256:x1869355210007808:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:0.0:1782756249.565338:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756249.565357:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198eed lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdecc expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.565670:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198ef4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.565687:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198ef4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.565700:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198ef4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.565714:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198efb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.565721:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198efb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.565735:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198efb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782756249.566873:0:5803:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1782756249.569781:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa198f02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.569804:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa198f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.569815:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa198f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.569854:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198ef4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.569862:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198ef4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.569869:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198ef4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.569875:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81aa00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756249.569879:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198ef4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.569887:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198ef4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.569900:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:0.0:1782756249.569903:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756249.569920:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198ef4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.569926:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198ef4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782756249.569939:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dcf263c4 reply state 00000000abb307c0 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198efb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756249.569949:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782756249.569988:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198eed lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdecc expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.571217:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa198f02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdecc expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.571229:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288700) 00010000:00010000:0.0:1782756249.571232:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782756249.571235:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81b000, rc 0) 00000100:00100000:0.0:1782756249.571307:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77003b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+14:10256:x1869355210007808:12345-192.168.204.25@tcp:101:bash.0 Request processed in 5990us (7130us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1782756249.571316:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 40 00010000:00010000:3.0:1782756249.575240:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198efb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756249.575258:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198efb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756249.575266:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198efb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756249.575272:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81a000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756249.575278:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198efb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756249.575304:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198efb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756249.575321:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d3c54288a00) 00010000:00010000:3.0:1782756249.575324:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756249.575329:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198efb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756249.575336:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198efb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756249.582723:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756249.582760:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210007936 00000100:00100000:1.0:1782756249.582770:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210007936 00000100:00100000:1.0:1782756249.582807:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20 00000100:00100000:1.0:1782756249.582815:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2354:x1869355210007936:12345-192.168.204.25@tcp:8:bash.0 00010000:00080000:1.0:1782756249.582866:0:6605:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 26487635-60cb-4aee-af8e-396654f6c3d8@192.168.204.25@tcp t0 exp 0000000000000000 cur 290 last 0 00000020:00000080:1.0:1782756249.582896:0:6605:0:(genops.c:1406:class_connect()) connect: client 26487635-60cb-4aee-af8e-396654f6c3d8, cookie 0x5e4fb0a8aa198f10 00002000:00100000:1.0:1782756249.582907:0:6605:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 26487635-60cb-4aee-af8e-396654f6c3d8/ffff9d3c76c08800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782756249.582918:0:6605:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782756249.583112:0:6605:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782756249.583140:0:6605:0:(import.c:65:import_set_state_nolock()) ffff9d3c76c0e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782756249.583204:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+6:2354:x1869355210007936:12345-192.168.204.25@tcp:8:bash.0 Request processed in 388us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756249.583212:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20 00000100:00100000:2.0:1782756249.587327:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756249.587615:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210008064 00000100:00100000:1.0:1782756249.587625:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210008064 00000100:00100000:1.0:1782756249.587692:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 21 00000100:00100000:1.0:1782756249.587703:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4b605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+6:0:x1869355210008064:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:1.0:1782756249.587720:0:6603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756249.587744:0:6603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa198f17 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cded3 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782756249.587770:0:6603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782756249.587788:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=290s v=(0 0) 00010000:00010000:1.0:1782756249.587793:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756249.587802:0:6603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa198f17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cded3 expref: 7 pid: 6603 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.587822:0:6603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa198f17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cded3 expref: 7 pid: 6603 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.587861:0:6603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef4c00, rc 0) 00000100:00100000:1.0:1782756249.587914:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4b605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+7:0:x1869355210008064:12345-192.168.204.25@tcp:101:bash.0 Request processed in 214us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756249.587921:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 21 00000100:00080000:3.0:1782756249.588238:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782756249.592152:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756249.592301:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210008192 00000100:00100000:2.0:1782756249.592311:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210008192 00000100:00100000:2.0:1782756249.592364:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 22 00000100:00100000:2.0:1782756249.592383:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77000a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+7:10256:x1869355210008192:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:2.0:1782756249.592402:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756249.592431:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa198f1e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdeda expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.592462:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa198f17 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cded3 expref: 8 pid: 6603 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.592471:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756249.592475:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756249.592480:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa198f1e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdeda expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.592512:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa198f17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cded3 expref: 8 pid: 6603 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.592526:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa198f17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cded3 expref: 8 pid: 6603 timeout: 390 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756249.592540:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b606a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6605:1869355222621184:192.168.204.25@tcp:104: 00000100:00100000:2.0:1782756249.592633:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a052480 going to sleep for 11 seconds 00000100:00100000:3.0:1782756249.595969:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b606a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6605:1869355222621184:192.168.204.25@tcp:104: 00010000:00010000:3.0:1782756249.596011:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa198f1e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdeda expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756249.596034:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63d800, rc 0) 00000100:00100000:3.0:1782756249.596115:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77000a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+8:10256:x1869355210008192:12345-192.168.204.25@tcp:101:bash.0 Request processed in 3732us (3970us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756249.596125:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 22 00000100:00100000:2.0:1782756249.601341:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756249.601668:0:8367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210008320 00000100:00100000:3.0:1782756249.601680:0:8367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210008320 00010000:00010000:3.0:1782756249.601723:0:8367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa198f17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cded3 expref: 8 pid: 6603 timeout: 390 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756249.601768:0:8367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 35 00000100:00100000:3.0:1782756249.601778:0:8367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4b607800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26487635-60cb-4aee-af8e-396654f6c3d8+8:2355:x1869355210008320:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782756249.601804:0:8367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756249.601827:0:8367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa198f17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cded3 expref: 8 pid: 6603 timeout: 390 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756249.602181:0:8367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa198f17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cded3 expref: 8 pid: 6603 timeout: 390 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756249.602211:0:8367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa198f17 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cded3 expref: 8 pid: 6603 timeout: 390 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756249.602229:0:8367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756249.602234:0:8367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756249.602243:0:8367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa198f1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdeda expref: 7 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756249.602255:0:8367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa198f1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdeda expref: 7 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756249.602300:0:8367:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa198f1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdeda expref: 7 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756249.602317:0:8367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb9ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8367:1869355222621312:192.168.204.25@tcp:105: 00000100:00100000:3.0:1782756249.602397:0:8367:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c540c6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782756249.607991:0:8367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb9ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8367:1869355222621312:192.168.204.25@tcp:105: 00010000:00010000:0.0:1782756249.608020:0:8367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756249.608094:0:8367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4b607800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26487635-60cb-4aee-af8e-396654f6c3d8+7:2355:x1869355210008320:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6316us (6766us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756249.608105:0:8367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 35 00000100:00100000:3.0:1782756249.608958:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756249.609036:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210008576 00000100:00100000:3.0:1782756249.609058:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210008576 00000100:00100000:3.0:1782756249.609122:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6 00000100:00100000:3.0:1782756249.609131:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+13:10256:x1869355210008576:12345-192.168.204.25@tcp:35:bash.0 00000100:00100000:3.0:1782756249.609829:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+14:10256:x1869355210008576:12345-192.168.204.25@tcp:35:bash.0 Request processed in 696us (870us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1782756249.609848:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6 00000001:00080000:0.0:1782756249.613506:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000100:00100000:3.0:1782756249.711874:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756249.714219:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210008832 00000100:00100000:2.0:1782756249.714234:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210008832 00000100:00100000:2.0:1782756249.714300:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 41 00000100:00100000:2.0:1782756249.714311:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+12:10266:x1869355210008832:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1782756249.714348:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756249.714367:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa198f25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdee1 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756249.714481:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1782756249.714614:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa198f25 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdee1 expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.714628:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c4ef38400) 00010000:00010000:2.0:1782756249.714632:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782756249.714637:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa198f25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdee1 expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.714653:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63d600, rc 0) 00000100:00100000:2.0:1782756249.714729:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+13:10266:x1869355210008832:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 421us (2867us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1782756249.714737:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 41 00000100:00100000:3.0:1782756249.719417:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756249.719634:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210009088 00000100:00100000:2.0:1782756249.719644:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210009088 00000100:00100000:2.0:1782756249.719711:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7 00000100:00100000:2.0:1782756249.719721:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+13:10266:x1869355210009088:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:2.0:1782756249.719995:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+14:10266:x1869355210009088:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 275us (595us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1782756249.720003:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7 00000100:00100000:0.0:1782756249.783616:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756249.783778:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210009216 00000100:00100000:1.0:1782756249.783789:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210009216 00000100:00100000:1.0:1782756249.783846:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 42 00000100:00100000:1.0:1782756249.783856:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7720aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+14:10272:x1869355210009216:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1782756249.783880:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756249.783901:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa198f33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdee8 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.783965:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa198f3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.783978:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa198f3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.783990:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa198f3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756249.784062:0:6579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1782756249.784066:0:6579:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1782756249.784131:0:6579:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa198f3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.784156:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa198f33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdee8 expref: 16 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.784179:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa198f3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdee8 expref: 15 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.784188:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:1.0:1782756249.784190:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782756249.784193:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef5e00, rc 0) 00000100:00100000:1.0:1782756249.784249:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7720aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+15:10272:x1869355210009216:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 394us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756249.784256:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 42 00000100:00100000:3.0:1782756249.795280:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756249.795777:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210009472 00000100:00100000:0.0:1782756249.795790:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210009472 00000100:00100000:0.0:1782756249.795948:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 43 00000100:00100000:0.0:1782756249.795961:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+15:10272:x1869355210009472:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1782756249.795989:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756249.796015:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198f41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdeef expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.796214:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b800/0x5e4fb0a8aa198f48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.796231:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b800/0x5e4fb0a8aa198f48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.796245:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b800/0x5e4fb0a8aa198f48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782756249.796258:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1782756249.796739:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198f41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdeef expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.796760:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b800/0x5e4fb0a8aa198f48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdeef expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.796767:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288700) 00010000:00010000:0.0:1782756249.796770:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782756249.796772:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81b800, rc 0) 00000100:00100000:0.0:1782756249.796908:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+17:10272:x1869355210009472:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 949us (1643us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1782756249.796938:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 43 00000100:00100000:3.0:1782756249.801371:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756249.801494:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210009728 00000100:00100000:1.0:1782756249.801508:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210009728 00000100:00100000:1.0:1782756249.801600:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 44 00000100:00100000:1.0:1782756249.801612:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+17:10272:x1869355210009728:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1782756249.801646:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756249.801673:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa198f56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdef6 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.801807:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa198f5d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.801826:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa198f5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.801840:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa198f5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756249.801854:0:6579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1782756249.802044:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa198f56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdef6 expref: 20 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.802066:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa198f5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdef6 expref: 19 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.802116:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288700) 00010000:00010000:1.0:1782756249.802120:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1782756249.802124:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef5800, rc 0) 00000100:00100000:1.0:1782756249.802203:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+19:10272:x1869355210009728:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 593us (850us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1782756249.802212:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 44 00000100:00100000:1.0:1782756249.806648:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756249.806759:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210009856 00000100:00100000:0.0:1782756249.806771:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210009856 00000100:00100000:0.0:1782756249.806955:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 2 00000100:00100000:0.0:1782756249.806971:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77001180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26487635-60cb-4aee-af8e-396654f6c3d8+19:2356:x1869355210009856:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782756249.806998:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756249.807045:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b800/0x5e4fb0a8aa198f48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdeef expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.807070:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288700) 00010000:00010000:0.0:1782756249.808370:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756249.808468:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77001180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26487635-60cb-4aee-af8e-396654f6c3d8+18:2356:x1869355210009856:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1497us (1832us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756249.808479:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 2 00000100:00100000:3.0:1782756249.810395:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756249.810593:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210009984 00000100:00100000:1.0:1782756249.810605:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210009984 00000100:00100000:1.0:1782756249.810681:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 23 00000100:00100000:1.0:1782756249.810694:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+7:2355:x1869355210009984:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:1.0:1782756249.810755:0:6603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d9dbb17/0x5e4fb0a8aa198f6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.810779:0:6603:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa198f1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdeda expref: 7 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.810789:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1782756249.810794:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782756249.810799:0:6603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d9dbb17/0x5e4fb0a8aa198f6b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.810997:0:6603:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa198f1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdeda expref: 7 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.811015:0:6603:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa198f1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdeda expref: 7 pid: 6605 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756249.811035:0:6603:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6603:1869355222621440:192.168.204.25@tcp:104: 00000100:00100000:1.0:1782756249.811181:0:6603:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76fc8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782756249.815593:0:6603:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6603:1869355222621440:192.168.204.25@tcp:104: 00010000:00010000:1.0:1782756249.815636:0:6603:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009d9dbb17/0x5e4fb0a8aa198f6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756249.819111:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756249.819391:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210010112 00000100:00100000:0.0:1782756249.819403:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210010112 00002000:00100000:0.0:1782756249.819521:0:6608:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9d3c7fb9c380 x1869355210010112/t0(0) o4->26487635-60cb-4aee-af8e-396654f6c3d8@192.168.204.25@tcp:430/0 lens 504/0 e 0 to 0 dl 1782756260 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782756249.819532:0:6608:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3c7fb9c380 with x1869355210010112 ext(0->12) 00010000:00010000:0.0:1782756249.819557:0:6608:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa198f1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdeda expref: 8 pid: 6605 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.819579:0:6608:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa198f1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdeda expref: 8 pid: 6605 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782756249.819587:0:6608:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d3c7fb9c380 00000100:00100000:0.0:1782756249.819638:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 0 00000100:00100000:0.0:1782756249.819649:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26487635-60cb-4aee-af8e-396654f6c3d8+8:2356:x1869355210010112:12345-192.168.204.25@tcp:4:lfs.0 00000001:00100000:0.0:1782756249.850457:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 26487635-60cb-4aee-af8e-396654f6c3d8 00000100:00100000:3.0:1782756249.851033:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26487635-60cb-4aee-af8e-396654f6c3d8+9:2356:x1869355210010112:12345-192.168.204.25@tcp:4:lfs.0 Request processed in 31381us (31927us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1782756249.851061:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 0 00002000:00100000:3.0:1782756249.851301:0:6608:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9d3c7fb9c380 x1869355210010112/t4294967299(0) o4->26487635-60cb-4aee-af8e-396654f6c3d8@192.168.204.25@tcp:430/0 lens 504/448 e 0 to 0 dl 1782756260 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782756249.851313:0:6608:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3c7fb9c380 with x1869355210010112 ext(0->12) 00010000:00010000:3.0:1782756249.851324:0:6608:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa198f1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdeda expref: 9 pid: 6605 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756249.851341:0:6608:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa198f1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdeda expref: 9 pid: 6605 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782756249.851350:0:6608:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d3c7fb9c380 00000100:00100000:3.0:1782756249.853840:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756249.854041:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210010240 00000100:00100000:2.0:1782756249.854057:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210010240 00010000:00010000:2.0:1782756249.854145:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa198f1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdeda expref: 9 pid: 6605 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756249.854196:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 36 00000100:00100000:2.0:1782756249.854204:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+9:2355:x1869355210010240:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782756249.854219:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1782756249.854235:0:5788:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1782756249.854238:0:5788:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1782756249 00002000:00010000:2.0:1782756249.854240:0:5788:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1782756249 00002000:00010000:2.0:1782756249.854243:0:5788:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1782756249 00010000:00010000:2.0:1782756249.854248:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa198f1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdeda expref: 9 pid: 6605 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.854262:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa198f1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdeda expref: 9 pid: 6605 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.854291:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa198f1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdeda expref: 9 pid: 6605 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.854308:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782756249.854312:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782756249.854318:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009d9dbb17/0x5e4fb0a8aa198f6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.854329:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d9dbb17/0x5e4fb0a8aa198f6b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.854363:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756249.854422:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+8:2355:x1869355210010240:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 217us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756249.854429:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 36 00010000:00010000:1.0:1782756249.854555:0:6603:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009d9dbb17/0x5e4fb0a8aa198f6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.854564:0:6603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d9dbb17/0x5e4fb0a8aa198f6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.854587:0:6603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d9dbb17/0x5e4fb0a8aa198f6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.854596:0:6603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d9dbb17/0x5e4fb0a8aa198f6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.854615:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d9dbb17/0x5e4fb0a8aa198f6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.854622:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5a00 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:1.0:1782756249.854626:0:6603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d9dbb17/0x5e4fb0a8aa198f6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.854635:0:6603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d9dbb17/0x5e4fb0a8aa198f6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.854646:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d9dbb17/0x5e4fb0a8aa198f6b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756249.854653:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d9dbb17/0x5e4fb0a8aa198f6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756249.854746:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+7:2355:x1869355210009984:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 44055us (44364us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756249.854753:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 23 00000100:00100000:3.0:1782756249.858275:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756249.858579:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210010496 00000100:00100000:2.0:1782756249.858589:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210010496 00000100:00100000:2.0:1782756249.858639:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8 00000100:00100000:2.0:1782756249.858650:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+18:10272:x1869355210010496:12345-192.168.204.25@tcp:35:lfs.0 00000004:00010000:2.0:1782756249.858714:0:5807:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa198f5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdef6 expref: 18 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782756249.858992:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1782756249.859049:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1782756249.859689:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1782756249.859748:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198f72 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.859764:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa198f02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdecc expref: 22 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.859773:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198f72 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.859805:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa198f02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdecc expref: 22 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.859821:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa198f02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdecc expref: 22 pid: 5803 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756249.859835:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c4b606a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5807:1869355222621568:192.168.204.25@tcp:104: 00000100:00100000:2.0:1782756249.859938:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a052180 going to sleep for 11 seconds 00000100:00100000:2.0:1782756249.864795:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756249.864934:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c4b606a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5807:1869355222621568:192.168.204.25@tcp:104: 00000100:00100000:0.0:1782756249.864934:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210010624 00000100:00100000:0.0:1782756249.864949:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210010624 00010000:00010000:3.0:1782756249.864977:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198f72 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.865002:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa198f02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdecc expref: 23 pid: 5803 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756249.865050:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 37 00000100:00100000:0.0:1782756249.865060:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+23:2355:x1869355210010624:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782756249.865718:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756249.865792:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa198f02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdecc expref: 23 pid: 5803 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.865809:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa198f02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdecc expref: 23 pid: 5803 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.865833:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa198f02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdecc expref: 23 pid: 5803 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.865849:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288700) 00010000:00010000:0.0:1782756249.865854:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198f72 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.865864:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198f72 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.865873:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198f72 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.866489:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756249.866587:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+22:2355:x1869355210010624:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1526us (1803us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756249.866596:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 37 00010000:00010000:3.0:1782756249.867844:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198f72 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756249.867862:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198f72 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782756249.868116:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1782756249.868718:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1782756249.869637:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ef2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1869355222621696:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1782756249.869862:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756249.869913:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78a50540 going to sleep for 11 seconds 00000100:00100000:0.0:1782756249.870192:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222621696 00000100:00100000:0.0:1782756249.870200:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222621696 00000100:00100000:0.0:1782756249.870265:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782756249.870275:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5807:x1869355222621696:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782756249.870377:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5807:x1869355222621696:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 104us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756249.870384:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782756249.870683:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ef2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1869355222621696:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1782756249.871766:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1782756249.871849:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76d78e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1869355222621824:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1782756249.871898:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756249.871918:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a052180 going to sleep for 11 seconds 00000100:00100000:0.0:1782756249.872049:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222621824 00000100:00100000:0.0:1782756249.872055:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222621824 00000100:00100000:0.0:1782756249.872117:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782756249.872127:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5807:x1869355222621824:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782756249.872307:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5807:x1869355222621824:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 183us (409us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1782756249.872315:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782756249.872512:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76d78e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1869355222621824:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1782756249.872576:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1782756249.872614:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198f72 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.872624:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198f72 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.872632:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198f72 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.872638:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63de00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756249.872642:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198f72 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.872650:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198f72 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.872664:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288700) 00010000:00010000:2.0:1782756249.872668:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1782756249.872681:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198f72 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756249.872687:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa198f72 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782756249.872846:0:5807:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1782756249.873888:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1782756249.873904:0:5807:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 291108828614ns, next at 292108826023ns, rc = 0 00000001:00080000:2.0:1782756249.873914:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1782756249.874053:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288700) 00010000:00010000:2.0:1782756249.874058:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1782756249.874068:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa198f5d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdef6 expref: 26 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756249.874601:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+25:10272:x1869355210010496:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 15951us (16333us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1782756249.874611:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8 00000020:00080000:2.0:1782756249.874616:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1782756249.878848:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756249.879270:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210010752 00000100:00100000:0.0:1782756249.879287:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210010752 00000100:00100000:0.0:1782756249.879380:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 45 00000100:00100000:0.0:1782756249.879394:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+25:10272:x1869355210010752:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1782756249.880145:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756249.880180:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa198f79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdefd expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.880553:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa198f79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdefd expref: 26 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.880573:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa198f79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdefd expref: 26 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.880599:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:0.0:1782756249.880603:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782756249.880607:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81b000, rc 0) 00000100:00100000:0.0:1782756249.880714:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+26:10272:x1869355210010752:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1322us (1875us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756249.880725:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 45 00000100:00100000:3.0:1782756249.885455:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756249.885930:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210011008 00000100:00100000:0.0:1782756249.886007:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210011008 00000100:00100000:0.0:1782756249.886069:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9 00000100:00100000:0.0:1782756249.886187:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4977f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+26:10272:x1869355210011008:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:1.0:1782756249.886447:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4977f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+27:10272:x1869355210011008:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 368us (1057us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1782756249.886456:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9 00000100:00100000:2.0:1782756249.957364:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756249.958327:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210011264 00000100:00100000:0.0:1782756249.958339:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210011264 00000100:00100000:0.0:1782756249.958456:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 46 00000100:00100000:0.0:1782756249.958468:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+27:10282:x1869355210011264:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1782756249.958495:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756249.958518:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b800/0x5e4fb0a8aa198f80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdf04 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782756249.958643:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1782756249.958789:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b800/0x5e4fb0a8aa198f80 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf04 expref: 29 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.958804:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c4ef38400) 00010000:00010000:0.0:1782756249.958808:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782756249.958813:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b800/0x5e4fb0a8aa198f80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf04 expref: 29 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.958826:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81b800, rc 0) 00000100:00100000:0.0:1782756249.958894:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+28:10282:x1869355210011264:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 429us (1541us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1782756249.958901:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 46 00000100:00100000:1.0:1782756249.962484:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756249.962644:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210011392 00000100:00100000:0.0:1782756249.962655:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210011392 00000100:00100000:0.0:1782756249.962714:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 47 00000100:00100000:0.0:1782756249.962725:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+28:10282:x1869355210011392:12345-192.168.204.25@tcp:34:lfs.0 00010000:00010000:0.0:1782756249.962800:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198f8e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.962818:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198f8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.962829:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198f8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.962843:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198f95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.962849:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.962869:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.962976:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198f9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.962984:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198f9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.962990:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198f9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782756249.963027:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198f9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.963039:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198f8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.963044:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198f8e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.963050:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198f8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.963055:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81aa00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756249.963059:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198f8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.963066:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198f8e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.963107:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:0.0:1782756249.963116:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756249.963121:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198f8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.963128:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa198f8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.963141:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.963147:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198f95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.963151:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198f95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.963157:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81be00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756249.963159:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198f95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.963165:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198f95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.963172:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d3c54288500) 00010000:00010000:0.0:1782756249.963174:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756249.963177:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198f95 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.963183:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198f95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.963196:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198f9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.963207:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198f9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.963369:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198f9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.963376:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81a000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756249.963379:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198f9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.963386:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198f9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.963394:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:0.0:1782756249.963406:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756249.963410:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198f9c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756249.963416:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198f9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756249.963558:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+28:10282:x1869355210011392:12345-192.168.204.25@tcp:34:lfs.0 Request processed in 833us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756249.963567:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 47 00000100:00100000:3.0:1782756249.968178:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756249.968347:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210011648 00000100:00100000:0.0:1782756249.968358:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210011648 00000100:00100000:0.0:1782756249.968417:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 10 00000100:00100000:0.0:1782756249.968427:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+28:10282:x1869355210011648:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:0.0:1782756249.970368:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+29:10282:x1869355210011648:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 1931us (2190us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1782756249.970399:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 10 00000100:00100000:3.0:1782756250.052862:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756250.052981:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210011904 00000100:00100000:1.0:1782756250.053004:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210011904 00000100:00100000:1.0:1782756250.053066:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 48 00000100:00100000:1.0:1782756250.053115:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+29:10285:x1869355210011904:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1782756250.053144:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756250.053167:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa198fa3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdf0b expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.053246:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa198faa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.053260:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa198faa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.053271:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa198faa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.053287:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa198fb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.053296:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa198fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.053303:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa198fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.053446:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa198fb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.053456:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa198fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.053464:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa198fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756250.053482:0:6579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1782756250.053594:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa198faa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.053602:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa198faa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.053609:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa198faa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.053615:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5a00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756250.053619:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa198faa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.053625:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa198faa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.053636:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:1.0:1782756250.053639:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756250.053643:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa198faa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.053649:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa198faa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.053661:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa198fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.053667:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa198fb1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.053683:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa198fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.053688:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5800 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756250.053690:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa198fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.053697:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa198fb1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.053705:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d3c4ef38300) 00010000:00010000:1.0:1782756250.053707:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756250.053709:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa198fb1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.053715:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa198fb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.053757:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa198fa3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf0b expref: 32 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.053772:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa198fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf0b expref: 31 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.053779:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:1.0:1782756250.053781:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782756250.053784:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef4800, rc 0) 00000100:00100000:1.0:1782756250.053848:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+31:10285:x1869355210011904:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 773us (995us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1782756250.053865:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 48 00000100:00100000:1.0:1782756250.058899:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756250.058989:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210012032 00000100:00100000:0.0:1782756250.058999:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210012032 00000100:00100000:0.0:1782756250.059058:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 49 00000100:00100000:0.0:1782756250.059069:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+31:10285:x1869355210012032:12345-192.168.204.25@tcp:54:lfs.0 00010000:00010000:0.0:1782756250.059171:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198fc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756250.059186:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756250.059198:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756250.059223:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756250.059229:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198fc6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756250.059235:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198fc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756250.059241:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81a000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756250.059245:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198fc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756250.059252:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198fc6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756250.059262:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:0.0:1782756250.059277:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782756250.059283:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198fc6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756250.059289:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198fc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756250.059364:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+31:10285:x1869355210012032:12345-192.168.204.25@tcp:54:lfs.0 Request processed in 297us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756250.059372:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 49 00010000:00010000:1.0:1782756250.061215:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782756250.062754:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756250.062844:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210012288 00000100:00100000:1.0:1782756250.062854:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210012288 00000100:00100000:1.0:1782756250.062907:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 11 00000100:00100000:1.0:1782756250.062916:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+31:10285:x1869355210012288:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:1.0:1782756250.063181:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+32:10285:x1869355210012288:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 265us (432us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1782756250.063190:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 11 00000100:00100000:3.0:1782756250.404890:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756250.405277:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210012544 00000100:00100000:1.0:1782756250.405292:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210012544 00000100:00100000:1.0:1782756250.405370:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 50 00000100:00100000:1.0:1782756250.405381:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+32:10316:x1869355210012544:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1782756250.405420:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756250.405446:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa198fcd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdf12 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.405592:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa198fd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.405610:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa198fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.405623:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa198fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756250.405636:0:6579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1782756250.405859:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa198fcd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf12 expref: 35 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.405881:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa198fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf12 expref: 34 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.405891:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:1.0:1782756250.405895:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782756250.405899:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef5800, rc 0) 00000100:00100000:1.0:1782756250.405975:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+34:10316:x1869355210012544:12345-192.168.204.25@tcp:101:cat.0 Request processed in 595us (1100us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1782756250.405983:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 50 00000100:00100000:2.0:1782756250.411730:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756250.411792:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756250.411886:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210012800 00000100:00100000:1.0:1782756250.411898:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210012800 00000100:00100000:1.0:1782756250.411973:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 12 00000100:00100000:1.0:1782756250.411985:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+34:10316:x1869355210012800:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1782756250.412382:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+35:10316:x1869355210012800:12345-192.168.204.25@tcp:35:cat.0 Request processed in 397us (664us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1782756250.412401:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 12 00000100:00100000:3.0:1782756250.413609:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210012928 00000100:00100000:3.0:1782756250.413620:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210012928 00000100:00100000:3.0:1782756250.413693:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3 00000100:00100000:3.0:1782756250.413704:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c501d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+35:2355:x1869355210012928:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782756250.413724:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756250.413761:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa198fd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf12 expref: 35 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756250.413787:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:3.0:1782756250.413815:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782756250.413886:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c501d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+34:2355:x1869355210012928:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 183us (2092us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756250.413894:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3 00000100:00100000:2.0:1782756250.475818:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756250.477284:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210013184 00000100:00100000:0.0:1782756250.477302:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210013184 00000100:00100000:0.0:1782756250.478249:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 51 00000100:00100000:0.0:1782756250.478276:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+34:10322:x1869355210013184:12345-192.168.204.25@tcp:101:dd.0 00010000:00010000:0.0:1782756250.478318:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756250.478322:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782756250.478361:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa198f3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdee8 expref: 34 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756250.478385:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:0.0:1782756250.478391:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782756250.478408:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198fe2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdf19 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756250.478688:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198fe9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756250.478706:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa198fb8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf0b expref: 34 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756250.478956:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198fe9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756250.479159:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa198fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf0b expref: 34 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756250.479181:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa198fb8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf0b expref: 34 pid: 6579 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756250.479200:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c77208e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1869355222621952:192.168.204.25@tcp:104: 00000100:00100000:0.0:1782756250.479344:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c77235e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782756250.484920:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c77208e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1869355222621952:192.168.204.25@tcp:104: 00010000:00010000:0.0:1782756250.484955:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198fe9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756250.486850:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756250.486946:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210013312 00000100:00100000:0.0:1782756250.486955:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210013312 00010000:00010000:0.0:1782756250.486993:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa198fb8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf0b expref: 35 pid: 6579 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756250.487036:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 38 00000100:00100000:0.0:1782756250.487046:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26487635-60cb-4aee-af8e-396654f6c3d8+35:2356:x1869355210013312:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782756250.487102:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756250.487110:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa198fb8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf0b expref: 35 pid: 6579 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756250.487135:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa198fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf0b expref: 35 pid: 6579 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756250.487158:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa198fb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf0b expref: 35 pid: 6579 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756250.487175:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:0.0:1782756250.487180:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198fe9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756250.487190:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198fe9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756250.487196:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198fe9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756250.487229:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756250.487289:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26487635-60cb-4aee-af8e-396654f6c3d8+34:2356:x1869355210013312:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 243us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756250.487303:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 38 00010000:00010000:1.0:1782756250.487316:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198fe9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.487332:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198fe9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756250.487362:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1782756250.487648:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa198fe2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf19 expref: 35 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.487692:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198fe9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf19 expref: 34 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.487702:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:1.0:1782756250.487706:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782756250.487710:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81be00, rc 0) 00000100:00100000:1.0:1782756250.487938:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+34:10322:x1869355210013184:12345-192.168.204.25@tcp:101:dd.0 Request processed in 9538us (12000us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1782756250.487950:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 51 00000100:00100000:2.0:1782756250.500677:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756250.500788:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210013568 00000100:00100000:1.0:1782756250.500814:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210013568 00000100:00100000:1.0:1782756250.500906:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 52 00000100:00100000:1.0:1782756250.500918:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+34:10322:x1869355210013568:12345-192.168.204.25@tcp:36:dd.0 00010000:00010000:1.0:1782756250.501339:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa198ff7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.501362:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa198ff7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.501376:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa198ff7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782756250.501436:0:6579:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1782756250.501477:0:6579:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000be804614 reply state 00000000b5ca8e9e transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa198ff7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756250.501488:0:6579:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782756250.501640:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+37:10322:x1869355210013568:12345-192.168.204.25@tcp:36:dd.0 Request processed in 722us (970us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1782756250.501648:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 52 00000020:00080000:1.0:1782756250.501654:0:6579:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1782756250.506770:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa198ff7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756250.506786:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa198ff7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756250.506807:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa198ff7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756250.506813:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4600 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756250.506817:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa198ff7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756250.506825:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa198ff7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756250.506842:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:2.0:1782756250.506844:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756250.506849:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa198ff7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756250.506855:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa198ff7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756250.764012:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756250.764138:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210013696 00000100:00100000:1.0:1782756250.764156:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210013696 00000100:00100000:1.0:1782756250.764265:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 53 00000100:00100000:1.0:1782756250.764277:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+36:10336:x1869355210013696:12345-192.168.204.25@tcp:101:stat.0 00010000:00010000:1.0:1782756250.764325:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756250.764354:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa198ffe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdf20 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.764444:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199005 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.764462:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199005 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.764475:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199005 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.764491:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa19900c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.764498:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa19900c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.764506:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa19900c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.764654:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199013 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.764697:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198fe9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf19 expref: 37 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.764707:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199013 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.764759:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198fe9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf19 expref: 37 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.764776:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198fe9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf19 expref: 37 pid: 5804 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756250.764792:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869355222622080:192.168.204.25@tcp:104: 00000100:00100000:1.0:1782756250.764972:0:5805:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76fc8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782756250.770058:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756250.770210:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210013952 00000100:00100000:0.0:1782756250.770227:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210013952 00000100:00100000:0.0:1782756250.770331:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13 00000100:00100000:0.0:1782756250.770345:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+38:5578:x1869355210013952:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1782756250.770656:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869355222622080:192.168.204.25@tcp:104: 00010000:00010000:1.0:1782756250.770688:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199013 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756250.770867:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+39:5578:x1869355210013952:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 522us (816us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1782756250.770877:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13 00000100:00100000:3.0:1782756250.774227:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756250.774403:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210014080 00000100:00100000:2.0:1782756250.774414:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210014080 00010000:00010000:2.0:1782756250.774457:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198fe9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf19 expref: 39 pid: 5804 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756250.774500:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 39 00000100:00100000:2.0:1782756250.774519:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+39:2355:x1869355210014080:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782756250.774544:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756250.774551:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198fe9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf19 expref: 39 pid: 5804 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756250.774580:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198fe9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf19 expref: 39 pid: 5804 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756250.774606:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa198fe9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf19 expref: 39 pid: 5804 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756250.774623:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:2.0:1782756250.774628:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199013 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756250.774638:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756250.774647:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199013 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756250.774681:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756250.774743:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+38:2355:x1869355210014080:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 233us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756250.774753:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 39 00010000:00010000:1.0:1782756250.774995:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.775004:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756250.775064:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1782756250.775069:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782756250.775146:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.775170:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.775181:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199005 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.775188:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199005 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.775194:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199005 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.775199:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4c00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756250.775204:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199005 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.775211:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199005 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.775221:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:1.0:1782756250.775224:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756250.775228:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199005 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.775233:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199005 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.775245:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa19900c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.775251:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa19900c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.775263:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa19900c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.775268:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756250.775271:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa19900c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.775278:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa19900c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.775286:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d3c4ef38300) 00010000:00010000:1.0:1782756250.775289:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756250.775292:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa19900c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.775297:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa19900c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.775337:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa198ffe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf20 expref: 38 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.775352:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199013 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf20 expref: 37 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.775359:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:1.0:1782756250.775361:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782756250.775363:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef5c00, rc 0) 00000100:00100000:1.0:1782756250.775400:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+37:10336:x1869355210013696:12345-192.168.204.25@tcp:101:stat.0 Request processed in 11125us (11399us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756250.775418:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 53 00000100:00100000:3.0:1782756250.856365:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756250.856870:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210014336 00000100:00100000:1.0:1782756250.856882:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210014336 00000100:00100000:1.0:1782756250.857812:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 54 00000100:00100000:1.0:1782756250.857830:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+37:10342:x1869355210014336:12345-192.168.204.25@tcp:36:truncate.0 00010000:00010000:1.0:1782756250.857903:0:6579:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756250.857933:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199013 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf20 expref: 37 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.857953:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:1.0:1782756250.857958:0:6579:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782756250.858352:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa19901a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.858368:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa19901a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756250.858379:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa19901a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782756250.858454:0:6579:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1782756250.858500:0:6579:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fd4b3466 reply state 00000000756b9013 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa19901a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756250.858511:0:6579:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782756250.859852:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+39:10342:x1869355210014336:12345-192.168.204.25@tcp:36:truncate.0 Request processed in 832us (2300us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1782756250.859871:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 54 00000020:00080000:1.0:1782756250.859968:0:6579:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1782756250.864769:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa19901a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756250.864801:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa19901a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756250.864818:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa19901a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756250.864824:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5a00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756250.864830:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa19901a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756250.864838:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa19901a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756250.864869:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:0.0:1782756250.864872:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756250.864880:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa19901a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756250.864887:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa19901a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756251.001228:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756251.001385:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210014464 00000100:00100000:0.0:1782756251.001401:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210014464 00000100:00100000:0.0:1782756251.001500:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 55 00000100:00100000:0.0:1782756251.001539:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4b607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+38:10356:x1869355210014464:12345-192.168.204.25@tcp:101:stat.0 00010000:00010000:0.0:1782756251.001567:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756251.001590:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa199021 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdf27 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.001678:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b800/0x5e4fb0a8aa199028 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.001692:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b800/0x5e4fb0a8aa199028 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.001703:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b800/0x5e4fb0a8aa199028 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.001716:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa19902f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.001723:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa19902f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.001729:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa19902f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.001828:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199036 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.001836:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199036 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.001843:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199036 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782756251.001898:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1782756251.001903:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782756251.001927:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199036 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.001948:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199036 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.001958:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b800/0x5e4fb0a8aa199028 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.001964:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b800/0x5e4fb0a8aa199028 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.001970:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b800/0x5e4fb0a8aa199028 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.001976:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81b800 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756251.001980:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b800/0x5e4fb0a8aa199028 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.001987:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b800/0x5e4fb0a8aa199028 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.001998:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:0.0:1782756251.002002:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756251.002006:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b800/0x5e4fb0a8aa199028 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.002012:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b800/0x5e4fb0a8aa199028 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.002024:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa19902f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.002030:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa19902f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.002042:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa19902f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.002046:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81ae00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756251.002049:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa19902f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.002056:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa19902f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.002064:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d3c54288500) 00010000:00010000:0.0:1782756251.002067:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756251.002070:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa19902f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.002119:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa19902f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.002151:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa199021 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf27 expref: 40 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.002176:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199036 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf27 expref: 39 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.002184:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:0.0:1782756251.002186:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782756251.002188:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81a200, rc 0) 00000100:00100000:0.0:1782756251.002558:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4b607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+39:10356:x1869355210014464:12345-192.168.204.25@tcp:101:stat.0 Request processed in 976us (1284us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756251.002577:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 55 00000100:00080000:3.0:1782756251.003475:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782756251.067023:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756251.067389:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210014720 00000100:00100000:0.0:1782756251.067404:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210014720 00000100:00100000:0.0:1782756251.067483:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 56 00000100:00100000:0.0:1782756251.067496:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4b606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+39:10366:x1869355210014720:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1782756251.067536:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756251.067566:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa19903d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdf2e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782756251.067736:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1782756251.067916:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa19903d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf2e expref: 41 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.067935:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c4ef38400) 00010000:00010000:0.0:1782756251.067938:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782756251.067945:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa19903d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf2e expref: 41 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.067963:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81aa00, rc 0) 00000100:00100000:0.0:1782756251.068046:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4b606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+40:10366:x1869355210014720:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 552us (1039us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1782756251.068056:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 56 00000100:00100000:3.0:1782756251.079787:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756251.079992:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210014976 00000100:00100000:0.0:1782756251.080005:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210014976 00000100:00100000:0.0:1782756251.080119:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14 00000100:00100000:0.0:1782756251.080132:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+40:10366:x1869355210014976:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:0.0:1782756251.080526:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+41:10366:x1869355210014976:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 385us (744us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1782756251.080535:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14 00010000:00010000:1.0:1782756251.084387:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782756251.132001:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756251.133174:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210015232 00000100:00100000:0.0:1782756251.133191:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210015232 00000100:00100000:1.0:1782756251.133409:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 57 00000100:00100000:1.0:1782756251.133422:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79df8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+41:10372:x1869355210015232:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:1.0:1782756251.133456:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756251.133484:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa19904b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdf35 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.133631:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199052 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.133652:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199036 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf27 expref: 42 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.133662:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199052 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.133707:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199036 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf27 expref: 42 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.133722:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199036 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf27 expref: 42 pid: 5804 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756251.133737:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78fc0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1869355222622208:192.168.204.25@tcp:104: 00000100:00100000:1.0:1782756251.133929:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76fc8000 going to sleep for 11 seconds 00000100:00100000:3.0:1782756251.138537:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756251.138762:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78fc0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1869355222622208:192.168.204.25@tcp:104: 00010000:00010000:1.0:1782756251.138802:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199052 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756251.141965:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210015360 00000100:00100000:0.0:1782756251.141987:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210015360 00010000:00010000:1.0:1782756251.149460:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199036 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf27 expref: 43 pid: 5804 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756251.149544:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 40 00000100:00100000:1.0:1782756251.149557:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26487635-60cb-4aee-af8e-396654f6c3d8+43:2356:x1869355210015360:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782756251.149580:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756251.149588:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199036 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf27 expref: 43 pid: 5804 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.149605:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199036 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf27 expref: 43 pid: 5804 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.149635:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199036 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf27 expref: 43 pid: 5804 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.149657:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:1.0:1782756251.149663:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199052 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.149674:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199052 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.149683:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199052 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.149730:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782756251.149816:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199052 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756251.149819:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26487635-60cb-4aee-af8e-396654f6c3d8+42:2356:x1869355210015360:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 265us (11304us total) trans 0 rc 0/0 00010000:00010000:3.0:1782756251.149825:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199052 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756251.149843:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 40 00000004:00200000:3.0:1782756251.149848:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1782756251.150101:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa19904b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf35 expref: 44 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756251.150120:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199052 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf35 expref: 42 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756251.150128:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:3.0:1782756251.150132:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782756251.150135:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef4000, rc 0) 00000100:00100000:3.0:1782756251.150167:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79df8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+42:10372:x1869355210015232:12345-192.168.204.25@tcp:101:bash.0 Request processed in 16747us (18182us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1782756251.150182:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 57 00000100:00100000:3.0:1782756251.161333:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756251.161598:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210015616 00000100:00100000:1.0:1782756251.161610:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210015616 00000100:00100000:1.0:1782756251.161688:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 58 00000100:00100000:1.0:1782756251.161700:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79dfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+42:10372:x1869355210015616:12345-192.168.204.25@tcp:36:bash.0 00010000:00010000:1.0:1782756251.162148:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199060 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.162171:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199060 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.162185:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199060 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782756251.162262:0:6579:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1782756251.162292:0:6579:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e2d4a889 reply state 000000005bcb090b transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199060 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756251.162303:0:6579:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782756251.162608:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79dfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+45:10372:x1869355210015616:12345-192.168.204.25@tcp:36:bash.0 Request processed in 906us (1287us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1782756251.162616:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 58 00000020:00080000:1.0:1782756251.162623:0:6579:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782756251.167143:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199060 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756251.167166:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199060 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756251.167174:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199060 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756251.167181:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4c00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756251.167187:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199060 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756251.167197:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199060 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756251.167217:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:3.0:1782756251.167220:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756251.167226:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199060 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756251.167234:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199060 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756251.169775:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756251.169884:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210015744 00000100:00100000:2.0:1782756251.169897:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210015744 00000100:00100000:2.0:1782756251.169966:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 59 00000100:00100000:2.0:1782756251.169977:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79dfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+44:10372:x1869355210015744:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:2.0:1782756251.170008:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756251.170032:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199067 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdf3c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756251.170196:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19906e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756251.170214:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199052 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf35 expref: 45 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756251.170225:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19906e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756251.170263:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199052 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf35 expref: 45 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756251.170280:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199052 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf35 expref: 45 pid: 5804 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756251.170299:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76d7bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869355222622336:192.168.204.25@tcp:104: 00000100:00100000:2.0:1782756251.170401:0:5805:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c45582240 going to sleep for 11 seconds 00000100:00100000:2.0:1782756251.173277:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76d7bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869355222622336:192.168.204.25@tcp:104: 00010000:00010000:2.0:1782756251.173315:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19906e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756251.174493:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756251.174598:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210015872 00000100:00100000:2.0:1782756251.174608:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210015872 00010000:00010000:2.0:1782756251.174651:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199052 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf35 expref: 46 pid: 5804 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756251.174693:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 41 00000100:00100000:2.0:1782756251.174722:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79df9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+46:2355:x1869355210015872:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782756251.174743:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756251.174750:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199052 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf35 expref: 46 pid: 5804 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756251.174765:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199052 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf35 expref: 46 pid: 5804 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756251.174793:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199052 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf35 expref: 46 pid: 5804 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756251.174824:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:2.0:1782756251.174829:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19906e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756251.174841:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19906e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756251.174851:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19906e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756251.174885:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756251.174947:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79df9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+45:2355:x1869355210015872:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 227us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756251.174955:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 41 00010000:00010000:1.0:1782756251.175217:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19906e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.175227:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19906e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756251.175284:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1782756251.175296:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782756251.175321:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19906e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.175357:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199067 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf3c expref: 45 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.175375:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19906e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf3c expref: 44 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.175384:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:1.0:1782756251.175387:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782756251.175390:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63de00, rc 0) 00000100:00100000:1.0:1782756251.175418:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79dfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+44:10372:x1869355210015744:12345-192.168.204.25@tcp:101:bash.0 Request processed in 5443us (5658us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756251.175424:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 59 00000100:00100000:0.0:1782756251.177393:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756251.177538:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210016128 00000100:00100000:1.0:1782756251.177548:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210016128 00000100:00100000:1.0:1782756251.177604:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15 00000100:00100000:1.0:1782756251.177615:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4977a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+44:10372:x1869355210016128:12345-192.168.204.25@tcp:35:bash.0 00000100:00100000:1.0:1782756251.177973:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4977a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+45:10372:x1869355210016128:12345-192.168.204.25@tcp:35:bash.0 Request processed in 360us (590us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1782756251.177981:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15 00000100:00100000:0.0:1782756251.228725:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756251.229030:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210016384 00000100:00100000:1.0:1782756251.229042:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210016384 00000100:00100000:1.0:1782756251.229144:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 60 00000100:00100000:1.0:1782756251.229156:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+45:10382:x1869355210016384:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1782756251.229189:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756251.229230:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa199075 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdf43 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756251.229386:0:6579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1782756251.229550:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa199075 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf43 expref: 47 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.229567:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c4ef38400) 00010000:00010000:1.0:1782756251.229571:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782756251.229577:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa199075 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf43 expref: 47 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.229594:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef5200, rc 0) 00000100:00100000:1.0:1782756251.229675:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+46:10382:x1869355210016384:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 522us (964us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1782756251.229683:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 60 00000100:00100000:3.0:1782756251.234590:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756251.234691:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210016512 00000100:00100000:1.0:1782756251.234703:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210016512 00000100:00100000:1.0:1782756251.234778:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 61 00000100:00100000:1.0:1782756251.234791:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+46:10382:x1869355210016512:12345-192.168.204.25@tcp:34:lfs.0 00010000:00010000:1.0:1782756251.234898:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa199083 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.234919:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa199083 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.234933:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa199083 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.234973:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19908a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.234981:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19908a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.234987:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19908a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.235156:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199091 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.235167:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199091 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.235175:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199091 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782756251.235230:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199091 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.235244:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa199083 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.235251:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa199083 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.235258:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa199083 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.235264:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756251.235270:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa199083 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.235287:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa199083 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.235302:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:1.0:1782756251.235306:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756251.235311:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa199083 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.235318:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa199083 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.235333:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19908a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.235340:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19908a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.235346:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19908a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.235351:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5600 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756251.235354:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19908a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.235360:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19908a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.235367:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d3c4ef38300) 00010000:00010000:1.0:1782756251.235370:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756251.235372:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19908a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.235403:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19908a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.235420:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199091 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.235426:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199091 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.235433:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199091 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.235438:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4400 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756251.235441:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199091 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.235447:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199091 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.235455:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:1.0:1782756251.235457:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756251.235460:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199091 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.235466:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199091 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756251.235564:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+46:10382:x1869355210016512:12345-192.168.204.25@tcp:34:lfs.0 Request processed in 773us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756251.235572:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 61 00000100:00100000:3.0:1782756251.240601:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756251.240741:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210016768 00000100:00100000:2.0:1782756251.240752:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210016768 00000100:00100000:2.0:1782756251.240818:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16 00000100:00100000:2.0:1782756251.240830:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+46:10382:x1869355210016768:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:2.0:1782756251.241216:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+47:10382:x1869355210016768:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 387us (627us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1782756251.241224:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16 00000100:00100000:0.0:1782756251.268899:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756251.269199:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210017024 00000100:00100000:1.0:1782756251.269214:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210017024 00000100:00100000:1.0:1782756251.269290:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 62 00000100:00100000:1.0:1782756251.269303:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+47:10385:x1869355210017024:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1782756251.269347:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756251.269615:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199098 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdf4a expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.269727:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19909f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.269745:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19909f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.269759:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19909f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.269776:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1990a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.269784:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1990a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.269791:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1990a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.269997:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1990ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.270008:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1990ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.270476:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1990ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756251.270491:0:6579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1782756251.270725:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19909f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.270733:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19909f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.270740:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19909f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.270747:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5600 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756251.270752:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19909f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.270759:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19909f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.270775:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:1.0:1782756251.270779:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756251.270784:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19909f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.270789:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19909f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.270805:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1990a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.270811:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1990a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.270827:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1990a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.270832:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756251.270835:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1990a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.270840:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1990a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.270848:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d3c4ef38300) 00010000:00010000:1.0:1782756251.270851:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756251.270853:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1990a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.270858:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1990a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.270918:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199098 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf4a expref: 50 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.270934:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1990ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf4a expref: 49 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.270941:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:1.0:1782756251.270943:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782756251.270947:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef5200, rc 0) 00000100:00100000:1.0:1782756251.271270:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+49:10385:x1869355210017024:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1968us (2388us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1782756251.271287:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 62 00000100:00100000:3.0:1782756251.275053:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756251.276998:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756251.277104:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210017152 00000100:00100000:3.0:1782756251.277116:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210017152 00000100:00100000:2.0:1782756251.277179:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210017280 00000100:00100000:2.0:1782756251.277186:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210017280 00000100:00100000:3.0:1782756251.277196:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 63 00000100:00100000:3.0:1782756251.277211:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79df8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+50:10385:x1869355210017152:12345-192.168.204.25@tcp:54:lfs.0 00000100:00100000:2.0:1782756251.277239:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 4 00000100:00100000:2.0:1782756251.277248:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+50:2356:x1869355210017280:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782756251.277261:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756251.277292:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1990ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf4a expref: 50 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756251.277299:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa1990bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756251.277319:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa1990bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756251.277333:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa1990bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756251.277706:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:2.0:1782756251.277714:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782756251.277715:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa1990bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756251.277725:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa1990bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756251.277732:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa1990bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756251.277739:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168ca00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756251.277744:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa1990bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756251.277754:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa1990bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756251.277764:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288d00) 00000100:00100000:2.0:1782756251.277840:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+49:2356:x1869355210017280:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 592us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756251.277848:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 4 00010000:00010000:3.0:1782756251.277858:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782756251.277864:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa1990bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756251.277872:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa1990bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756251.277913:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79df8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+48:10385:x1869355210017152:12345-192.168.204.25@tcp:54:lfs.0 Request processed in 706us (2873us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756251.277920:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 63 00000100:00100000:3.0:1782756251.280341:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756251.280582:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210017536 00000100:00100000:0.0:1782756251.280595:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210017536 00000100:00100000:0.0:1782756251.280667:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17 00000100:00100000:0.0:1782756251.280677:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+48:10385:x1869355210017536:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:0.0:1782756251.280964:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+49:10385:x1869355210017536:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 288us (634us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1782756251.280972:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17 00000100:00100000:0.0:1782756251.490248:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756251.490454:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210017792 00000100:00100000:1.0:1782756251.490467:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210017792 00000100:00100000:1.0:1782756251.490558:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 64 00000100:00100000:1.0:1782756251.490569:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+49:10403:x1869355210017792:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1782756251.490601:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756251.490626:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa1990c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdf51 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.490922:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1990c9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.490941:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1990c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.490955:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1990c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756251.490968:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1782756251.491526:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa1990c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf51 expref: 52 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.491554:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1990c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf51 expref: 51 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.491564:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:1.0:1782756251.491570:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1782756251.491574:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef5000, rc 0) 00000100:00100000:1.0:1782756251.491843:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+51:10403:x1869355210017792:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1273us (1607us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1782756251.492503:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 64 00000100:00100000:3.0:1782756251.546410:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756251.550114:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210017920 00000100:00100000:0.0:1782756251.550136:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210017920 00000100:00100000:0.0:1782756251.550237:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 65 00000100:00100000:0.0:1782756251.550250:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+51:10404:x1869355210017920:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1782756251.550283:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756251.550309:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1990d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdf58 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.550435:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa1990de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.550460:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa1990de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.550474:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa1990de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782756251.550750:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1782756251.550756:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782756251.550784:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa1990de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.550817:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1990d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf58 expref: 53 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.550841:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa1990de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf58 expref: 52 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.550851:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:0.0:1782756251.550855:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782756251.550990:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81a200, rc 0) 00000100:00100000:0.0:1782756251.551143:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+52:10404:x1869355210017920:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 894us (4747us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756251.551152:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 65 00000100:00100000:3.0:1782756251.563209:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756251.563740:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210018304 00000100:00100000:0.0:1782756251.563753:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210018304 00000100:00100000:0.0:1782756251.563837:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18 00000100:00100000:0.0:1782756251.563849:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79df8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+52:10404:x1869355210018304:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:0.0:1782756251.564316:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79df8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+53:10404:x1869355210018304:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 467us (1120us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1782756251.564343:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18 00000100:00100000:1.0:1782756251.568357:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756251.568481:0:8367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210018432 00000100:00100000:0.0:1782756251.568494:0:8367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210018432 00000100:00100000:0.0:1782756251.568586:0:8367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5 00000100:00100000:0.0:1782756251.568598:0:8367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26487635-60cb-4aee-af8e-396654f6c3d8+53:10404:x1869355210018432:12345-192.168.204.25@tcp:103:lfs.0 00010000:00010000:0.0:1782756251.568617:0:8367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1782756251.568648:0:8367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19906e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf3c expref: 53 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.568676:0:8367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1990c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf51 expref: 52 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.568689:0:8367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa198f79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdefd expref: 51 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756251.568701:0:8367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:0.0:1782756251.568714:0:8367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756251.568780:0:8367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26487635-60cb-4aee-af8e-396654f6c3d8+50:10404:x1869355210018432:12345-192.168.204.25@tcp:103:lfs.0 Request processed in 184us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756251.568789:0:8367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5 00000100:00100000:3.0:1782756251.578723:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756251.579416:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210018560 00000100:00100000:2.0:1782756251.579430:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210018560 00000100:00100000:2.0:1782756251.579516:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 66 00000100:00100000:2.0:1782756251.579529:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+50:10404:x1869355210018560:12345-192.168.204.25@tcp:58:lfs.0 00010000:00010000:2.0:1782756251.579684:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa1990e5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756251.579705:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa1990e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756251.579725:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa1990e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782756251.581893:0:6579:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782756251.582355:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1782756251.582434:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1782756251.582685:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+50:10404:x1869355210018560:12345-192.168.204.25@tcp:58:lfs.0 Request processed in 3149us (3969us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756251.582701:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 66 00000100:00100000:1.0:1782756251.596758:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c79df8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222622464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782756251.596867:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756251.597250:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222622464 00000100:00100000:3.0:1782756251.597262:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222622464 00000100:00100000:3.0:1782756251.597586:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782756251.597600:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222622464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782756251.597646:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782756251.597716:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222622464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756251.597724:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782756251.597822:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c79df8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222622464:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782756251.598154:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782756251.609468:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756251.609617:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210018688 00000100:00100000:1.0:1782756251.609630:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210018688 00000100:00100000:1.0:1782756251.609710:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 67 00000100:00100000:1.0:1782756251.609722:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+50:10406:x1869355210018688:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1782756251.609749:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756251.609775:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5400/0x5e4fb0a8aa1990ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdf5f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.609859:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1990f3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.609876:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1990f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.609889:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1990f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.609906:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1990fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.609913:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1990fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.609945:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1990fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.610071:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199101 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.610128:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.610135:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756251.610180:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1782756251.610185:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782756251.610209:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.610222:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.610232:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1990f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.610239:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1990f3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.610246:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1990f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.610252:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756251.610257:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1990f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.610274:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1990f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.610289:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:1.0:1782756251.610293:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756251.610298:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1990f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.610304:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1990f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.610320:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1990fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.610326:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1990fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.610332:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1990fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.610337:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4e00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756251.610340:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1990fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.610345:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1990fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.610351:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d3c4ef38300) 00010000:00010000:1.0:1782756251.610354:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756251.610357:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1990fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.610373:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1990fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.610407:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5400/0x5e4fb0a8aa1990ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf5f expref: 52 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.610421:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199101 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf5f expref: 51 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756251.610429:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c58212500) 00010000:00010000:1.0:1782756251.610432:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782756251.610435:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef5600, rc 0) 00000100:00100000:1.0:1782756251.610531:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+51:10406:x1869355210018688:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 810us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756251.610538:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 67 00010000:00010000:1.0:1782756252.118283:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782756252.453858:0:11850:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782756252.453868:0:11850:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782756252.453907:0:11850:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1782756252.453913:0:11850:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1782756252.561769:0:11537:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782756252.561777:0:11537:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782756252.561823:0:11537:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1782756252.561834:0:11537:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782756252.561960:0:11537:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c79df9500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11537:1869355222622592:192.168.204.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782756252.562801:0:11537:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a1183c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782756252.575484:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756252.575722:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210018816 00000100:00100000:2.0:1782756252.575733:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210018816 00000100:00100000:2.0:1782756252.575790:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1 00000100:00100000:2.0:1782756252.575801:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:26487635-60cb-4aee-af8e-396654f6c3d8+52:10418:x1869355210018816:12345-192.168.204.25@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1782756252.575884:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:26487635-60cb-4aee-af8e-396654f6c3d8+52:10418:x1869355210018816:12345-192.168.204.25@tcp:900:lhsmtool_posix.0 Request processed in 84us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756252.575891:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1 00000100:00100000:0.0:1782756252.577731:0:11537:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c79df9500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11537:1869355222622592:192.168.204.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782756252.578304:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756252.578451:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210018944 00000100:00100000:0.0:1782756252.578458:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210018944 00000100:00100000:0.0:1782756252.578522:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 68 00000100:00100000:0.0:1782756252.578532:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+51:10418:x1869355210018944:12345-192.168.204.25@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782756252.578570:0:5803:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782756252.579234:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+51:10418:x1869355210018944:12345-192.168.204.25@tcp:53:lhsmtool_posix.0 Request processed in 701us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756252.579242:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 68 00000100:00100000:2.0:1782756252.585248:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756252.587120:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210019072 00000100:00100000:1.0:1782756252.587135:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210019072 00000100:00100000:1.0:1782756252.587207:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 69 00000100:00100000:1.0:1782756252.587217:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+51:10418:x1869355210019072:12345-192.168.204.25@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1782756252.587292:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199108 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.587309:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199108 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.587336:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199108 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.587366:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19910f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.587374:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19910f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.587381:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19910f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.587407:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199116 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.587415:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199116 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.587422:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199116 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756252.587457:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1782756252.587461:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782756252.587476:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199116 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.587495:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199108 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.587503:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199108 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.587519:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199108 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.587525:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756252.587530:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199108 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.587538:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199108 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.587550:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3c54288100) 00010000:00010000:1.0:1782756252.587553:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756252.587557:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199108 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.587563:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199108 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.587574:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19910f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.587581:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19910f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.587808:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19910f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.587814:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4c00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756252.587818:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19910f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.587833:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19910f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.587843:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9d3c4ef38300) 00010000:00010000:1.0:1782756252.587845:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756252.587848:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19910f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.587853:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19910f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.587868:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199116 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.587875:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199116 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.587881:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199116 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.587886:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5c00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756252.587889:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199116 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.587895:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199116 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.587902:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c58212500) 00010000:00010000:1.0:1782756252.587904:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756252.587906:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199116 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.587922:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199116 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756252.588058:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+51:10418:x1869355210019072:12345-192.168.204.25@tcp:34:lhsmtool_posix.0 Request processed in 840us (2818us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756252.588066:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 69 00000100:00100000:0.0:1782756252.604307:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756252.604381:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210019328 00000100:00100000:3.0:1782756252.604390:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210019328 00000100:00100000:3.0:1782756252.604446:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 70 00000100:00100000:3.0:1782756252.604456:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+51:10418:x1869355210019328:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782756252.604477:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756252.604507:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa19911d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdf66 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.604618:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199124 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.604633:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.604644:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782756252.604656:0:6579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1782756252.604754:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.604762:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199124 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.604768:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199124 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.604774:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168ca00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756252.604785:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199124 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.604793:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199124 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.604805:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c58212500) 00010000:00010000:3.0:1782756252.604808:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782756252.604812:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199124 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.604819:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199124 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.604860:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa19911d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf66 expref: 53 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.604870:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3c54288100) 00010000:00010000:3.0:1782756252.604873:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782756252.604877:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa19911d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf66 expref: 53 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.604887:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168cc00, rc 0) 00000100:00100000:3.0:1782756252.604943:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+52:10418:x1869355210019328:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 488us (892us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1782756252.604951:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 70 00000100:00100000:1.0:1782756252.608783:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756252.608850:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210019456 00000100:00100000:3.0:1782756252.608859:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210019456 00000100:00100000:3.0:1782756252.608944:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 71 00000100:00100000:3.0:1782756252.608954:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+52:10418:x1869355210019456:12345-192.168.204.25@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782756252.609021:0:5805:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782756252.609157:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+52:10418:x1869355210019456:12345-192.168.204.25@tcp:53:lhsmtool_posix.0 Request processed in 204us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756252.609165:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 71 00000100:00100000:0.0:1782756252.616449:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756252.617012:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210019712 00000100:00100000:3.0:1782756252.617022:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210019712 00000100:00100000:3.0:1782756252.617113:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 72 00000100:00100000:3.0:1782756252.617124:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+52:10418:x1869355210019712:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782756252.617145:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756252.617149:0:6579:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782756252.617176:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa1990de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf58 expref: 52 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.617192:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:3.0:1782756252.617197:0:6579:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782756252.617211:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199132 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdf6d expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782756252.617638:0:6579:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1782756252.617835:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199139 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.617848:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.617856:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.617919:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199132 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf6d expref: 54 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.617935:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199139 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf6d expref: 53 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.617942:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d3c49e15300) 00010000:00010000:3.0:1782756252.617944:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782756252.617946:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168c200, rc 0) 00000100:00100000:3.0:1782756252.618006:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+53:10418:x1869355210019712:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 884us (1567us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1782756252.618013:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 72 00000100:00100000:0.0:1782756252.624422:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756252.624515:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210019968 00000100:00100000:1.0:1782756252.624525:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210019968 00000100:00100000:1.0:1782756252.624835:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 73 00000100:00100000:1.0:1782756252.624851:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+53:10418:x1869355210019968:12345-192.168.204.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782756252.624921:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756252.624949:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199139 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf6d expref: 53 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.624971:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d3c49e15300) 00010000:00010000:1.0:1782756252.626982:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782756252.627016:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199147 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.627035:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199147 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.627047:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199147 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.627064:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19914e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x512dc6fb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.627118:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19914e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x512dc6fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.627125:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19914e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x512dc6fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.627206:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199147 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.627215:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199147 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.627221:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199147 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.627227:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5c00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756252.627232:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199147 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.627239:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199147 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.627251:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:1.0:1782756252.627254:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756252.627259:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199147 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.627265:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199147 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.636696:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19914e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x512dc6fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.636724:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19914e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x512dc6fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.636733:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19914e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x512dc6fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.636739:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4c00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756252.636745:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19914e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x512dc6fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.636753:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19914e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x512dc6fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.636772:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x512dc6fb (ffff9d3c4ef38300) 00010000:00010000:1.0:1782756252.636775:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756252.636781:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19914e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x512dc6fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.636787:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19914e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x512dc6fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756252.636918:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+52:10418:x1869355210019968:12345-192.168.204.25@tcp:36:lhsmtool_posix.0 Request processed in 12066us (12501us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782756252.636928:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 73 00000100:00100000:2.0:1782756252.642714:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756252.642781:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210020096 00000100:00100000:0.0:1782756252.642791:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210020096 00000100:00100000:0.0:1782756252.642851:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 74 00000100:00100000:0.0:1782756252.642861:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+52:10418:x1869355210020096:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782756252.642882:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756252.642905:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b800/0x5e4fb0a8aa199155 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdf74 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756252.642937:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19915c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756252.642950:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19915c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756252.642960:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19915c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756252.643347:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b800/0x5e4fb0a8aa199155 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf74 expref: 54 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756252.643367:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19915c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf74 expref: 53 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756252.643381:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:0.0:1782756252.643384:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782756252.643387:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81a200, rc 0) 00000100:00100000:0.0:1782756252.643446:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+53:10418:x1869355210020096:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 586us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756252.643453:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 74 00000100:00100000:1.0:1782756252.650865:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756252.651448:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210020352 00000100:00100000:3.0:1782756252.651458:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210020352 00000100:00100000:3.0:1782756252.651529:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 75 00000100:00100000:3.0:1782756252.651540:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+53:10418:x1869355210020352:12345-192.168.204.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782756252.651729:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199163 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.651746:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199163 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.651758:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199163 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782756252.652361:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1782756252.652373:0:5805:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 293887297690ns, next at 294887294671ns, rc = 0 00000004:00010000:3.0:1782756252.652473:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cc294b71 reply state 00000000af795d7f transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199163 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756252.652483:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782756252.652608:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+55:10418:x1869355210020352:12345-192.168.204.25@tcp:36:lhsmtool_posix.0 Request processed in 1067us (1750us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1782756252.652616:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 75 00010000:00010000:1.0:1782756252.662737:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199163 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.662754:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199163 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.662775:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199163 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.662781:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168d200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756252.662786:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199163 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.662795:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199163 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.662812:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:1.0:1782756252.662815:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782756252.662821:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199163 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.662829:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199163 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756252.669744:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756252.670704:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210020480 00000100:00100000:2.0:1782756252.670716:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210020480 00000100:00100000:2.0:1782756252.670778:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 76 00000100:00100000:2.0:1782756252.670788:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+54:10418:x1869355210020480:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782756252.670815:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756252.670835:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa19916a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdf7b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756252.670895:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa19916a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf7b expref: 55 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756252.670919:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa19916a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf7b expref: 55 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756252.670941:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:2.0:1782756252.670945:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782756252.670948:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63dc00, rc 0) 00000100:00100000:2.0:1782756252.671699:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+55:10418:x1869355210020480:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 909us (1962us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756252.671708:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 76 00000100:00100000:3.0:1782756252.681022:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756252.681088:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210020608 00000100:00100000:3.0:1782756252.681098:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210020608 00000100:00100000:3.0:1782756252.681137:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 24 00000100:00100000:3.0:1782756252.681145:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79df8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2354:x1869355210020608:12345-192.168.204.25@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1782756252.681173:0:6602:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 26487635-60cb-4aee-af8e-396654f6c3d8@192.168.204.25@tcp t0 exp 0000000000000000 cur 293 last 0 00000020:00000080:3.0:1782756252.681205:0:6602:0:(genops.c:1406:class_connect()) connect: client 26487635-60cb-4aee-af8e-396654f6c3d8, cookie 0x5e4fb0a8aa199171 00002000:00100000:3.0:1782756252.681215:0:6602:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 26487635-60cb-4aee-af8e-396654f6c3d8/ffff9d3b42afc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782756252.681226:0:6602:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782756252.681460:0:6602:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782756252.681500:0:6602:0:(import.c:65:import_set_state_nolock()) ffff9d3b42afc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782756252.681567:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79df8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+6:2354:x1869355210020608:12345-192.168.204.25@tcp:8:lhsmtool_posix.0 Request processed in 420us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756252.681574:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 24 00000100:00100000:2.0:1782756252.686771:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756252.687315:0:10416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210020736 00000100:00100000:1.0:1782756252.687326:0:10416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210020736 00000100:00100000:2.0:1782756252.687481:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 25 00000100:00100000:2.0:1782756252.687501:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+6:0:x1869355210020736:12345-192.168.204.25@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1782756252.687976:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782756252.803853:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+7:0:x1869355210020736:12345-192.168.204.25@tcp:2:lhsmtool_posix.0 Request processed in 116344us (117081us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1782756252.803867:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 25 00000001:00080000:1.0:1782756252.803945:0:6627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:1.0:1782756252.803958:0:6627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 26487635-60cb-4aee-af8e-396654f6c3d8 00000100:00100000:3.0:1782756252.809524:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756252.809686:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210020992 00000100:00100000:1.0:1782756252.809696:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210020992 00000100:00100000:1.0:1782756252.809763:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19 00000100:00100000:1.0:1782756252.809774:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+55:10418:x1869355210020992:12345-192.168.204.25@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1782756252.810172:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+56:10418:x1869355210020992:12345-192.168.204.25@tcp:35:lhsmtool_posix.0 Request processed in 398us (657us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1782756252.810195:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19 00000100:00100000:3.0:1782756252.816706:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756252.816854:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210021248 00000100:00100000:1.0:1782756252.816865:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210021248 00000100:00100000:1.0:1782756252.816927:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 77 00000100:00100000:1.0:1782756252.816938:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79df9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+56:10418:x1869355210021248:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1782756252.817108:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79df9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+56:10418:x1869355210021248:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 Request processed in 137us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756252.817116:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 77 00000100:00100000:3.0:1782756252.821248:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756252.822574:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210021376 00000100:00100000:0.0:1782756252.822648:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210021376 00000100:00100000:0.0:1782756252.822769:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 78 00000100:00100000:0.0:1782756252.822792:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+56:10418:x1869355210021376:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782756252.822815:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756252.822837:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa199178 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdf82 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756252.822909:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa19917f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756252.822923:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa19917f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756252.822934:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa19917f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782756252.822973:0:6579:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782756252.823005:0:6579:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa19917f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756252.823032:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa199178 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf82 expref: 58 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756252.823064:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa19917f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf82 expref: 57 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756252.823229:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:0.0:1782756252.823234:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1782756252.823237:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81b000, rc 0) 00000100:00100000:0.0:1782756252.823307:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+57:10418:x1869355210021376:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 517us (2068us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756252.823315:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 78 00000100:00100000:2.0:1782756252.828018:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756252.828137:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210021504 00000100:00100000:3.0:1782756252.828148:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210021504 00000100:00100000:3.0:1782756252.828223:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 26 00000100:00100000:3.0:1782756252.828250:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+5:2357:x1869355210021504:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782756252.828272:0:6602:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756252.828299:0:6602:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a4be169/0x5e4fb0a8aa199186 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdf89 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782756252.828329:0:6602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a42b39c, blocks: 0x1 00010000:00010000:3.0:1782756252.828365:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=294s v=(0 0) 00010000:00010000:3.0:1782756252.828370:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756252.828379:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a4be169/0x5e4fb0a8aa199186 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf89 expref: 6 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.828401:0:6602:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a4be169/0x5e4fb0a8aa199186 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf89 expref: 6 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.828415:0:6602:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168cc00, rc 0) 00000100:00100000:3.0:1782756252.828489:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+6:2357:x1869355210021504:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 233us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756252.828497:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 26 00000100:00100000:1.0:1782756252.832749:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756252.832845:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210021760 00000100:00100000:0.0:1782756252.832855:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210021760 00000100:00100000:0.0:1782756252.832977:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 79 00000100:00100000:0.0:1782756252.832999:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+57:10418:x1869355210021760:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782756252.833150:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+57:10418:x1869355210021760:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 Request processed in 163us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756252.833156:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 79 00000100:00100000:2.0:1782756252.838975:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756252.839155:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210021888 00000100:00100000:3.0:1782756252.839166:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210021888 00000100:00100000:3.0:1782756252.839223:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 27 00000100:00100000:3.0:1782756252.839233:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+6:10418:x1869355210021888:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782756252.839254:0:6603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756252.839275:0:6603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec8f52d7/0x5e4fb0a8aa19918d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdf90 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.839332:0:6603:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a4be169/0x5e4fb0a8aa199186 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf89 expref: 7 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.839344:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756252.839348:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756252.839355:0:6603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec8f52d7/0x5e4fb0a8aa19918d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf90 expref: 7 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.839399:0:6603:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009a4be169/0x5e4fb0a8aa199186 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf89 expref: 7 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.839414:0:6603:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009a4be169/0x5e4fb0a8aa199186 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf89 expref: 7 pid: 6602 timeout: 394 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756252.839439:0:6603:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c79dfbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6603:1869355222622720:192.168.204.25@tcp:104: 00000100:00100000:3.0:1782756252.839615:0:6603:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a118cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782756252.847875:0:6603:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c79dfbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6603:1869355222622720:192.168.204.25@tcp:104: 00010000:00010000:3.0:1782756252.847916:0:6603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ec8f52d7/0x5e4fb0a8aa19918d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf90 expref: 7 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.847940:0:6603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168ca00, rc 0) 00000100:00100000:3.0:1782756252.848002:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+7:10418:x1869355210021888:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 8769us (9036us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756252.848011:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 27 00000100:00100000:1.0:1782756252.848720:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756252.848830:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210022016 00000100:00100000:0.0:1782756252.848837:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210022016 00010000:00010000:0.0:1782756252.848870:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009a4be169/0x5e4fb0a8aa199186 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf89 expref: 7 pid: 6602 timeout: 394 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756252.848946:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 42 00000100:00100000:0.0:1782756252.848958:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c501d5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26487635-60cb-4aee-af8e-396654f6c3d8+7:2355:x1869355210022016:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782756252.848974:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756252.849003:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009a4be169/0x5e4fb0a8aa199186 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf89 expref: 7 pid: 6602 timeout: 394 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756252.849017:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009a4be169/0x5e4fb0a8aa199186 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf89 expref: 7 pid: 6602 timeout: 394 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756252.849042:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a4be169/0x5e4fb0a8aa199186 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf89 expref: 7 pid: 6602 timeout: 394 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756252.849057:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782756252.849062:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782756252.849070:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec8f52d7/0x5e4fb0a8aa19918d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf90 expref: 6 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756252.849137:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec8f52d7/0x5e4fb0a8aa19918d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf90 expref: 6 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756252.849178:0:5790:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ec8f52d7/0x5e4fb0a8aa19918d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf90 expref: 6 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756252.849192:0:5790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76f8c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5790:1869355222622848:192.168.204.25@tcp:105: 00000100:00100000:0.0:1782756252.849259:0:5790:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c77235c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782756252.852567:0:5790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76f8c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5790:1869355222622848:192.168.204.25@tcp:105: 00010000:00010000:0.0:1782756252.852645:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756252.852706:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c501d5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26487635-60cb-4aee-af8e-396654f6c3d8+6:2355:x1869355210022016:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3750us (3988us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756252.852733:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 42 00000100:00100000:1.0:1782756252.853861:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756252.854007:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210022144 00000100:00100000:3.0:1782756252.854018:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210022144 00002000:00100000:3.0:1782756252.854125:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9d3c78ed9c00 x1869355210022144/t0(0) o4->26487635-60cb-4aee-af8e-396654f6c3d8@192.168.204.25@tcp:433/0 lens 504/0 e 0 to 0 dl 1782756263 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782756252.854139:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3c78ed9c00 with x1869355210022144 ext(0->8) 00002000:00010000:3.0:1782756252.854147:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d3c78ed9c00 00000100:00100000:3.0:1782756252.854181:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 0 00000100:00100000:3.0:1782756252.854193:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26487635-60cb-4aee-af8e-396654f6c3d8+6:2355:x1869355210022144:12345-192.168.204.25@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1782756252.858401:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26487635-60cb-4aee-af8e-396654f6c3d8+8:2355:x1869355210022144:12345-192.168.204.25@tcp:4:lhsmtool_posix.0 Request processed in 4201us (4542us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1782756252.858415:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 0 00002000:00100000:3.0:1782756252.858428:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9d3c78ed9c00 x1869355210022144/t4294967302(0) o4->26487635-60cb-4aee-af8e-396654f6c3d8@192.168.204.25@tcp:433/0 lens 504/448 e 0 to 0 dl 1782756263 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782756252.858438:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3c78ed9c00 with x1869355210022144 ext(0->8) 00002000:00010000:3.0:1782756252.858446:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d3c78ed9c00 00000100:00100000:0.0:1782756252.864533:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756252.864992:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210022272 00000100:00100000:2.0:1782756252.865002:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210022272 00000100:00100000:2.0:1782756252.865407:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 80 00000100:00100000:2.0:1782756252.865420:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+57:10418:x1869355210022272:12345-192.168.204.25@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1782756252.924520:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000001:00080000:3.0:1782756252.924547:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1782756252.924767:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1782756252.924857:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d3c4a052f00 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1782756252.924862:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d3c4b909e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d3c4a052480 00000020:00080000:3.0:1782756252.924865:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d3c4b909500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d3c76d9ec00 00000020:00080000:2.0:1782756252.924900:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1782756252.925123:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1782756252.925546:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222622976:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782756252.925700:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756252.925863:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222622976 00000100:00100000:1.0:1782756252.925872:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222622976 00000100:00100000:1.0:1782756252.925931:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782756252.925942:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1869355222622976:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782756252.925969:0:6602:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1782756252.926091:0:6602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a42b399, atime: 0x6a42b399, ctime: 0x6a42b399, blocks: 0x1 00010000:00010000:1.0:1782756252.926100:0:6602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058f1ada4/0x5e4fb0a8aa199194 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.926116:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=294s v=(0 0) 00010000:00010000:1.0:1782756252.926120:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756252.926199:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058f1ada4/0x5e4fb0a8aa199194 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.926218:0:6602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058f1ada4/0x5e4fb0a8aa199194 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.926236:0:6602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058f1ada4/0x5e4fb0a8aa199194 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.926245:0:6602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058f1ada4/0x5e4fb0a8aa199194 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.926339:0:6602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782756252.927501:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3315:x1869355222622976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1557us (1797us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1782756252.927512:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1782756252.927541:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782756252.927555:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782756252.927561:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058f1ada4/0x5e4fb0a8aa199194 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.927573:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5e00 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:1.0:1782756252.927577:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058f1ada4/0x5e4fb0a8aa199194 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.927599:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058f1ada4/0x5e4fb0a8aa199194 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.927616:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058f1ada4/0x5e4fb0a8aa199194 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.927635:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058f1ada4/0x5e4fb0a8aa199194 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756252.927657:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756252.927659:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756252.927661:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782756252.927995:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d3c7fb9d180/2, rc 0, transno 4294967301 00000100:00100000:0.0:1782756252.928003:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222622976:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782756252.928464:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+20:10418:x1869355210022272:12345-192.168.204.25@tcp:44:lhsmtool_posix.0 Request processed in 63043us (63939us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756252.928475:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 80 00000004:00080000:3.0:1782756252.929405:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:2.0:1782756252.929705:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782756252.929968:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76f8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222623104:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1782756252.930253:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756252.931059:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756252.931445:0:10416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222623104 00000100:00100000:0.0:1782756252.931453:0:10416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222623104 00000100:00100000:0.0:1782756252.931515:0:10416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210022400 00000100:00100000:0.0:1782756252.931519:0:10416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210022400 00000100:00100000:0.0:1782756252.931554:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782756252.931565:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222623104:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1782756252.931754:0:10416:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1782756252.931758:0:10416:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1782756252 00002000:00010000:0.0:1782756252.931761:0:10416:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1782756252.931763:0:10416:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1782756252 -> 1782756252 00002000:00010000:0.0:1782756252.931765:0:10416:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1782756252.931815:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3317:x1869355222623104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 252us (1562us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1782756252.931822:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782756252.931839:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 30 00000100:00100000:0.0:1782756252.931847:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+8:2355:x1869355210022400:12345-192.168.204.25@tcp:16:lhsmtool_posix.0 00000004:00080000:2.0:1782756252.932184:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d3c76f8d500/2, rc 0, transno 4294967303 00000100:00100000:2.0:1782756252.932192:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76f8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222623104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1782756252.969153:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756252.969197:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756252.969222:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756252.969289:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210022528 00000100:00100000:3.0:1782756252.969299:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210022528 00000100:00100000:3.0:1782756252.969371:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 274 00000100:00100000:3.0:1782756252.969381:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2356:x1869355210022528:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756252.969456:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2356:x1869355210022528:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 77us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756252.969464:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 274 00000100:00100000:3.0:1782756252.969508:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210022784 00000100:00100000:3.0:1782756252.969512:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210022784 00000100:00100000:3.0:1782756252.969549:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 104 00000100:00100000:3.0:1782756252.969556:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2356:x1869355210022784:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756252.969699:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2356:x1869355210022784:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 142us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756252.969706:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 104 00000100:00100000:3.0:1782756252.969726:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210022656 00000100:00100000:3.0:1782756252.969729:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210022656 00000100:00100000:3.0:1782756252.969761:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 56 00000100:00100000:3.0:1782756252.969768:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+7:2356:x1869355210022656:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756252.969795:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+7:2356:x1869355210022656:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 27us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756252.969800:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 56 00000100:00080000:3.0:1782756252.969820:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782756252.969824:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782756252.977462:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+8:2355:x1869355210022400:12345-192.168.204.25@tcp:16:lhsmtool_posix.0 Request processed in 45605us (46395us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756252.977476:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 30 00000001:00080000:1.0:1782756252.977912:0:6627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1782756252.977925:0:6627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1782756252.979854:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756252.979946:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210023040 00000100:00100000:0.0:1782756252.979954:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210023040 00000100:00100000:3.0:1782756252.980635:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 81 00000100:00100000:3.0:1782756252.980660:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+13:10418:x1869355210023040:12345-192.168.204.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782756252.980733:0:6579:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756252.980768:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa19917f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf82 expref: 13 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.980806:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:3.0:1782756252.980811:0:6579:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782756252.980851:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa19919b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.980866:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa19919b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.980878:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa19919b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782756252.981256:0:6579:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000096a8981b reply state 0000000036988ea1 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa19919b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756252.981282:0:6579:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782756252.981538:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+14:10418:x1869355210023040:12345-192.168.204.25@tcp:36:lhsmtool_posix.0 Request processed in 887us (1688us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1782756252.981548:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 81 00010000:00010000:3.0:1782756252.984923:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa19919b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.984944:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa19919b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.984953:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa19919b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.984960:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168c400 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756252.984966:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa19919b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.985119:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa19919b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.985143:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:3.0:1782756252.985147:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756252.985153:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa19919b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.985161:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa19919b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756252.986274:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756252.986335:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210023168 00000100:00100000:3.0:1782756252.986349:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210023168 00000100:00100000:2.0:1782756252.986528:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 31 00000100:00100000:2.0:1782756252.986545:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+6:2356:x1869355210023168:12345-192.168.204.25@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1782756252.987344:0:6603:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1782756252.987349:0:6603:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1782756252 -> 1782756250 00002000:00010000:2.0:1782756252.987351:0:6603:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1782756249 00002000:00010000:2.0:1782756252.987353:0:6603:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1782756252 -> 1782756250 00002000:00010000:2.0:1782756252.987354:0:6603:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1782756252.987417:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+7:2356:x1869355210023168:12345-192.168.204.25@tcp:2:lhsmtool_posix.0 Request processed in 877us (1150us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1782756252.987425:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 31 00000100:00100000:0.0:1782756252.991407:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756252.991616:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210023424 00000100:00100000:3.0:1782756252.991628:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210023424 00000100:00100000:3.0:1782756252.991699:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 82 00000100:00100000:3.0:1782756252.991710:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+13:10418:x1869355210023424:12345-192.168.204.25@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1782756252.991797:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1991a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.991815:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19915c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf74 expref: 13 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.991826:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1991a2 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.991867:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19915c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf74 expref: 13 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.991908:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19915c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf74 expref: 13 pid: 6579 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756252.992192:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c79dfb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869355222623232:192.168.204.25@tcp:104: 00000100:00100000:3.0:1782756252.992348:0:5805:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a118840 going to sleep for 11 seconds 00000100:00100000:3.0:1782756252.996665:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c79dfb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869355222623232:192.168.204.25@tcp:104: 00010000:00010000:3.0:1782756252.996704:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1991a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756252.997315:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756252.997955:0:8367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210023552 00000100:00100000:3.0:1782756252.997966:0:8367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210023552 00010000:00010000:3.0:1782756252.998020:0:8367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19915c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf74 expref: 14 pid: 6579 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756252.998066:0:8367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 43 00000100:00100000:3.0:1782756252.998112:0:8367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26487635-60cb-4aee-af8e-396654f6c3d8+14:2356:x1869355210023552:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782756252.998133:0:8367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756252.998141:0:8367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19915c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf74 expref: 14 pid: 6579 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.998156:0:8367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19915c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf74 expref: 14 pid: 6579 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.998182:0:8367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19915c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf74 expref: 14 pid: 6579 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.998225:0:8367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:3.0:1782756252.998231:0:8367:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1991a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.998243:0:8367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1991a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.998252:0:8367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1991a2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756252.998287:0:8367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782756252.998413:0:8367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26487635-60cb-4aee-af8e-396654f6c3d8+13:2356:x1869355210023552:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 336us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756252.998420:0:8367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 43 00010000:00010000:0.0:1782756252.998622:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1991a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756252.998642:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1991a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756252.998676:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1991a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756252.998683:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1991a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756252.998691:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1991a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756252.998697:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168d600 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756252.998702:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1991a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756252.998710:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1991a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756252.998721:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:0.0:1782756252.998724:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1782756252.998728:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1991a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756252.998735:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1991a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756252.998796:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+12:10418:x1869355210023424:12345-192.168.204.25@tcp:55:lhsmtool_posix.0 Request processed in 7088us (7402us total) trans 0 rc -22/-22 00000100:00100000:0.0:1782756252.998806:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 82 00000100:00100000:1.0:1782756253.001353:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756253.001458:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210023680 00000100:00100000:2.0:1782756253.001473:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210023680 00000100:00100000:2.0:1782756253.001554:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 32 00000100:00100000:2.0:1782756253.001794:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+7:2355:x1869355210023680:12345-192.168.204.25@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1782756253.001843:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c46886f8/0x5e4fb0a8aa1991a9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.001874:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec8f52d7/0x5e4fb0a8aa19918d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf90 expref: 7 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.001883:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756253.001887:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782756253.001893:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c46886f8/0x5e4fb0a8aa1991a9 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.001928:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ec8f52d7/0x5e4fb0a8aa19918d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf90 expref: 7 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.001943:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ec8f52d7/0x5e4fb0a8aa19918d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf90 expref: 7 pid: 6603 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756253.001957:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76d78380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6605:1869355222623360:192.168.204.25@tcp:104: 00000100:00100000:2.0:1782756253.002360:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c46950900 going to sleep for 11 seconds 00000100:00100000:1.0:1782756253.011174:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756253.011326:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76d78380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6605:1869355222623360:192.168.204.25@tcp:104: 00010000:00010000:2.0:1782756253.011361:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c46886f8/0x5e4fb0a8aa1991a9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756253.011689:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210023808 00000100:00100000:3.0:1782756253.011701:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210023808 00010000:00010000:3.0:1782756253.011745:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ec8f52d7/0x5e4fb0a8aa19918d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf90 expref: 8 pid: 6603 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756253.011844:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 44 00000100:00100000:3.0:1782756253.011855:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+8:2355:x1869355210023808:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782756253.011872:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756253.011894:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ec8f52d7/0x5e4fb0a8aa19918d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf90 expref: 8 pid: 6603 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756253.011909:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ec8f52d7/0x5e4fb0a8aa19918d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf90 expref: 8 pid: 6603 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756253.011955:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec8f52d7/0x5e4fb0a8aa19918d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf90 expref: 8 pid: 6603 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756253.011971:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782756253.011975:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782756253.011980:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c46886f8/0x5e4fb0a8aa1991a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756253.011990:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c46886f8/0x5e4fb0a8aa1991a9 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756253.012032:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782756253.012114:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c46886f8/0x5e4fb0a8aa1991a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.012137:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c46886f8/0x5e4fb0a8aa1991a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756253.012151:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+7:2355:x1869355210023808:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 295us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756253.012161:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 44 00010000:00010000:2.0:1782756253.012176:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c46886f8/0x5e4fb0a8aa1991a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.012337:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c46886f8/0x5e4fb0a8aa1991a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.012349:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c46886f8/0x5e4fb0a8aa1991a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.012357:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63c000 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:2.0:1782756253.012362:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c46886f8/0x5e4fb0a8aa1991a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.012373:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c46886f8/0x5e4fb0a8aa1991a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.012394:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c46886f8/0x5e4fb0a8aa1991a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.012403:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c46886f8/0x5e4fb0a8aa1991a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756253.012498:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+6:2355:x1869355210023680:12345-192.168.204.25@tcp:1:lhsmtool_posix.0 Request processed in 10707us (11156us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756253.012507:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 32 00000100:00100000:0.0:1782756253.019444:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756253.020375:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210024064 00000100:00100000:2.0:1782756253.020387:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210024064 00000100:00100000:2.0:1782756253.020543:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 83 00000100:00100000:2.0:1782756253.020555:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+12:10418:x1869355210024064:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1782756253.020638:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa1991b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.020655:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa1991b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.020667:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa1991b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.020908:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63ca00/0x5e4fb0a8aa1991b7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.020919:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa19916a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf7b expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.020928:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63ca00/0x5e4fb0a8aa1991b7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.020972:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa19916a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf7b expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782756253.021190:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782756253.021333:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa19916a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf7b expref: 13 pid: 5803 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756253.021355:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76d78380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1869355222623488:192.168.204.25@tcp:104: 00000100:00100000:2.0:1782756253.021448:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c46950900 going to sleep for 11 seconds 00000100:00100000:2.0:1782756253.026564:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76d78380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1869355222623488:192.168.204.25@tcp:104: 00010000:00010000:2.0:1782756253.026594:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63ca00/0x5e4fb0a8aa1991b7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756253.030689:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756253.031048:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210024192 00000100:00100000:2.0:1782756253.031059:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210024192 00010000:00010000:2.0:1782756253.031139:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa19916a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf7b expref: 14 pid: 5803 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756253.031182:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 45 00000100:00100000:2.0:1782756253.031191:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+14:2356:x1869355210024192:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782756253.031207:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756253.031214:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa19916a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf7b expref: 14 pid: 5803 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.031226:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa19916a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf7b expref: 14 pid: 5803 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.031249:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa19916a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf7b expref: 14 pid: 5803 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.031284:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:2.0:1782756253.031290:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63ca00/0x5e4fb0a8aa1991b7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.031299:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63ca00/0x5e4fb0a8aa1991b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.031306:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63ca00/0x5e4fb0a8aa1991b7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.031332:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756253.031395:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+13:2356:x1869355210024192:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 204us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756253.031402:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 45 00010000:00010000:0.0:1782756253.031648:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63ca00/0x5e4fb0a8aa1991b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756253.031656:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63ca00/0x5e4fb0a8aa1991b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782756253.031840:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1782756253.031992:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1782756253.032382:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1782756253.032465:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76f8f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5803:1869355222623616:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782756253.032527:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756253.032556:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c772353c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782756253.033390:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222623616 00000100:00100000:2.0:1782756253.033398:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222623616 00000100:00100000:2.0:1782756253.033452:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782756253.033461:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5803:x1869355222623616:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782756253.033583:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5803:x1869355222623616:12345-0@lo:1000:mdt00_000.0 Request processed in 123us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756253.033590:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782756253.033628:0:5803:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1782756253.033633:0:5803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d3c76f8d500, transno 4294967303 00000100:00100000:2.0:1782756253.033647:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76f8f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5803:1869355222623616:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1782756253.034271:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1782756253.034339:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76d78380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5803:1869355222623744:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782756253.034384:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756253.034405:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c50a44240 going to sleep for 11 seconds 00000100:00080000:1.0:1782756253.034568:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782756253.034773:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222623744 00000100:00100000:2.0:1782756253.034778:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222623744 00000100:00100000:2.0:1782756253.034800:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782756253.034807:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5803:x1869355222623744:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782756253.035211:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5803:x1869355222623744:12345-0@lo:1000:mdt00_000.0 Request processed in 403us (826us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1782756253.035218:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782756253.036538:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76d78380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5803:1869355222623744:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1782756253.036580:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63ca00/0x5e4fb0a8aa1991b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.036591:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63ca00/0x5e4fb0a8aa1991b7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.036598:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63ca00/0x5e4fb0a8aa1991b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.036604:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63ca00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756253.036621:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63ca00/0x5e4fb0a8aa1991b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.036629:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63ca00/0x5e4fb0a8aa1991b7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.036646:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d3c54288d00) 00010000:00010000:1.0:1782756253.036649:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782756253.036653:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63ca00/0x5e4fb0a8aa1991b7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.036659:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63ca00/0x5e4fb0a8aa1991b7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.036698:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa1990e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.036705:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa1990e5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.036710:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa1990e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.036715:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d800 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756253.036718:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa1990e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.036724:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa1990e5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.036731:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c58212500) 00010000:00010000:1.0:1782756253.036734:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782756253.036745:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa1990e5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.036751:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa1990e5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.036772:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1991be lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.036785:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199101 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf5f expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.036793:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1991be lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.036826:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199101 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf5f expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.036839:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199101 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf5f expref: 16 pid: 5804 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756253.036851:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fae3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1869355222623872:192.168.204.25@tcp:104: 00000100:00100000:1.0:1782756253.038449:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a700840 going to sleep for 11 seconds 00000100:00100000:0.0:1782756253.043470:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756253.043585:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fae3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1869355222623872:192.168.204.25@tcp:104: 00010000:00010000:1.0:1782756253.043614:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1991be lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756253.043726:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210024320 00000100:00100000:2.0:1782756253.043733:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210024320 00010000:00010000:2.0:1782756253.043771:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199101 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf5f expref: 17 pid: 5804 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756253.043809:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 46 00000100:00100000:2.0:1782756253.043819:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26487635-60cb-4aee-af8e-396654f6c3d8+17:2355:x1869355210024320:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782756253.043835:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756253.043842:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199101 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf5f expref: 17 pid: 5804 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.043853:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199101 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf5f expref: 17 pid: 5804 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.043876:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199101 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf5f expref: 17 pid: 5804 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.043891:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c58212500) 00010000:00010000:2.0:1782756253.043909:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1991be lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.043919:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1991be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.043927:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1991be lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.043956:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756253.044018:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26487635-60cb-4aee-af8e-396654f6c3d8+16:2355:x1869355210024320:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 199us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756253.044026:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 46 00010000:00010000:1.0:1782756253.044148:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1991be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.044156:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1991be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.044174:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1991be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.044181:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1991be lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.044187:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1991be lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.044194:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4c00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756253.044198:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1991be lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.044205:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1991be lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.044214:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c58212500) 00010000:00010000:1.0:1782756253.044216:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756253.044220:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1991be lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.044226:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1991be lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.044236:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa1991b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.044242:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa1991b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.044252:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa1991b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.044266:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63c800 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756253.044269:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa1991b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.044275:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa1991b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.044284:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c58212500) 00010000:00010000:1.0:1782756253.044287:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782756253.044289:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa1991b0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.044295:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa1991b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756253.044506:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+15:10418:x1869355210024064:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 Request processed in 23953us (25071us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1782756253.044514:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 83 00000020:00080000:1.0:1782756253.044518:0:5803:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1782756253.044714:0:11537:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782756253.044719:0:11537:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782756253.044745:0:11537:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1782756253.044751:0:11537:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782756253.048200:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756253.048315:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210024576 00000100:00100000:0.0:1782756253.048325:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210024576 00000100:00100000:0.0:1782756253.048384:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20 00000100:00100000:0.0:1782756253.048395:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+15:10418:x1869355210024576:12345-192.168.204.25@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1782756253.050293:0:5807:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1782756253.050413:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1782756253.050475:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1991c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.053135:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1991c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.053150:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1991c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.053181:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1991c5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.053188:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1991c5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.053193:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1991c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756253.053223:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782756253.053255:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782756253.053262:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1991c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.053268:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5200 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:2.0:1782756253.053273:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1991c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.053280:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1991c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.053294:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d3c4ef38300) 00010000:00010000:2.0:1782756253.053298:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782756253.053310:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1991c5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.053317:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1991c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756253.053337:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756253.053339:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756253.053341:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756253.053466:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+17:10418:x1869355210024576:12345-192.168.204.25@tcp:35:lhsmtool_posix.0 Request processed in 5069us (5276us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1782756253.053488:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20 00000020:00080000:1.0:1782756253.053494:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1782756253.132429:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c79dfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869355222624256:0@lo:400:kworker.0 00000100:00100000:3.0:1782756253.132512:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756253.132720:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c79dfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222624000:0@lo:400:kworker.0 00000100:00100000:2.0:1782756253.132756:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756253.132801:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782756253.132807:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869355222624384:0@lo:400:kworker.0 00000100:00100000:2.0:1782756253.132839:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756253.132870:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c79df9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869355222624128:0@lo:400:kworker.0 00000100:00100000:2.0:1782756253.132898:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756253.132930:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222624000 00000100:00100000:2.0:1782756253.132937:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222624000 00000100:00100000:2.0:1782756253.132976:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1782756253.132986:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4ab42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3317:x1869355222624000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756253.133038:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4ab42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3317:x1869355222624000:12345-0@lo:400:kworker.0 Request processed in 52us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756253.133058:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1782756253.133125:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c79dfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222624000:0@lo:400:kworker.0 00000100:00100000:2.0:1782756253.133150:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222624256 00000100:00100000:2.0:1782756253.133154:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222624256 00000100:00100000:2.0:1782756253.133186:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222624384 00000100:00100000:2.0:1782756253.133188:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222624384 00000100:00100000:2.0:1782756253.133209:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222624128 00000100:00100000:2.0:1782756253.133211:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222624128 00000100:00100000:2.0:1782756253.133222:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1782756253.133228:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869355222624256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756253.133259:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869355222624256:12345-0@lo:400:kworker.0 Request processed in 31us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756253.133266:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1782756253.133276:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1782756253.133282:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869355222624384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756253.133313:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869355222624384:12345-0@lo:400:kworker.0 Request processed in 31us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756253.133319:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1782756253.133329:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1782756253.133347:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869355222624128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756253.133377:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869355222624128:12345-0@lo:400:kworker.0 Request processed in 42us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756253.133382:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1782756253.133407:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c79df9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869355222624128:0@lo:400:kworker.0 00000100:00080000:2.0:1782756253.133422:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782756253.133435:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869355222624384:0@lo:400:kworker.0 00000100:00100000:3.0:1782756253.133717:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c79dfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869355222624256:0@lo:400:kworker.0 00000100:00100000:3.0:1782756253.133987:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222624512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782756253.134020:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756253.134148:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222624512 00000100:00100000:1.0:1782756253.134153:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222624512 00000100:00100000:1.0:1782756253.134190:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782756253.134198:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1869355222624512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782756253.134226:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782756253.134267:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1869355222624512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756253.134273:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782756253.134306:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222624512:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782756253.134464:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782756254.094815:0:11537:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782756254.094827:0:11537:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782756254.094859:0:11537:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1782756254.094866:0:11537:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1782756254.162047:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782756254.345823:0:11903:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782756254.345836:0:11903:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782756254.345900:0:11903:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1782756254.345910:0:11903:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782756254.428599:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756254.428762:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210024832 00000100:00100000:2.0:1782756254.428782:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210024832 00000100:00100000:2.0:1782756254.428894:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 84 00000100:00100000:2.0:1782756254.428905:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+17:10435:x1869355210024832:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1782756254.428933:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756254.428970:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa1991cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdf97 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756254.429275:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63ca00/0x5e4fb0a8aa1991d3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756254.429290:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63ca00/0x5e4fb0a8aa1991d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756254.429301:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63ca00/0x5e4fb0a8aa1991d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756254.429609:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1782756254.429861:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa1991cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf97 expref: 20 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756254.429883:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63ca00/0x5e4fb0a8aa1991d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf97 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756254.429893:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:2.0:1782756254.429896:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782756254.429900:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63ca00, rc 0) 00000100:00100000:2.0:1782756254.430064:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+19:10435:x1869355210024832:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1160us (1474us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1782756254.430099:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 84 00000100:00100000:0.0:1782756254.434474:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756254.434525:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210024960 00000100:00100000:1.0:1782756254.434535:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210024960 00000100:00100000:1.0:1782756254.434598:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 85 00000100:00100000:1.0:1782756254.434610:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+19:10435:x1869355210024960:12345-192.168.204.25@tcp:34:lfs.0 00010000:00010000:1.0:1782756254.434702:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5400/0x5e4fb0a8aa1991e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.434720:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5400/0x5e4fb0a8aa1991e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.434732:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5400/0x5e4fb0a8aa1991e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.434850:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1991e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.434860:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1991e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.434868:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1991e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.435412:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1991ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.435425:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1991ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.435434:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1991ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782756254.435482:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1991ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.435501:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5400/0x5e4fb0a8aa1991e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.435507:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5400/0x5e4fb0a8aa1991e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.435515:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5400/0x5e4fb0a8aa1991e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.435520:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5400 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756254.435524:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5400/0x5e4fb0a8aa1991e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.435532:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5400/0x5e4fb0a8aa1991e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.435544:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:0.0:1782756254.435547:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756254.435550:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5400/0x5e4fb0a8aa1991e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.435557:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5400/0x5e4fb0a8aa1991e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.435568:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1991e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.435574:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1991e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.435581:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1991e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.435592:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4e00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756254.435595:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1991e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.435602:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1991e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.435609:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d3c4ef38500) 00010000:00010000:0.0:1782756254.435611:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756254.435613:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1991e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.435618:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1991e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.435632:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1991ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.435639:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1991ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.435645:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1991ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.435648:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81aa00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756254.435651:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1991ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.435657:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1991ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.435672:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c54288500) 00010000:00010000:0.0:1782756254.435674:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756254.435677:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1991ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.435683:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1991ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756254.435770:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+19:10435:x1869355210024960:12345-192.168.204.25@tcp:34:lfs.0 Request processed in 1161us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756254.435778:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 85 00000100:00100000:1.0:1782756254.478954:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756254.479232:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210025216 00000100:00100000:1.0:1782756254.479243:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210025216 00000100:00100000:1.0:1782756254.479296:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 86 00000100:00100000:1.0:1782756254.479305:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+19:10438:x1869355210025216:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1782756254.479391:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756254.479413:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1991f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdf9e expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.479495:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1991fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.479510:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1991fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.479531:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1991fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.479547:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199204 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.479555:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199204 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.479561:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199204 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.482815:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19920b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.482841:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19920b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.482853:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19920b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756254.482867:0:6579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1782756254.482986:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1991fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.482994:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1991fd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.483001:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1991fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.483006:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756254.483019:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1991fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.483027:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1991fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.483729:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:1.0:1782756254.483733:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756254.483739:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1991fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.483746:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1991fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.483762:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199204 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.483768:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199204 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.483774:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199204 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.483780:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4400 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756254.483784:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199204 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.483790:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199204 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.483798:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d3c4ef38800) 00010000:00010000:1.0:1782756254.483801:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756254.483811:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199204 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.483818:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199204 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.483878:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1991f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf9e expref: 22 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.483895:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19920b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf9e expref: 21 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.483903:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:1.0:1782756254.483905:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782756254.483908:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef4c00, rc 0) 00000100:00100000:1.0:1782756254.484049:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+21:10438:x1869355210025216:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 4743us (5102us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1782756254.484059:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 86 00000100:00100000:3.0:1782756254.490280:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756254.490767:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210025344 00000100:00100000:0.0:1782756254.490779:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210025344 00000100:00100000:0.0:1782756254.490929:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 87 00000100:00100000:0.0:1782756254.490941:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+21:10438:x1869355210025344:12345-192.168.204.25@tcp:54:lfs.0 00010000:00010000:0.0:1782756254.491017:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199219 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.491034:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199219 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.491046:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199219 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.491095:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199219 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.491103:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199219 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.491124:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199219 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.491131:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81a200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756254.491135:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199219 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.491143:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199219 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.491155:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:0.0:1782756254.491158:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782756254.491162:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199219 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.491169:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199219 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756254.492567:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+21:10438:x1869355210025344:12345-192.168.204.25@tcp:54:lfs.0 Request processed in 1622us (2290us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756254.492580:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 87 00000100:00100000:3.0:1782756254.499369:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756254.499589:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210025600 00000100:00100000:1.0:1782756254.499601:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210025600 00000100:00100000:1.0:1782756254.499827:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 21 00000100:00100000:1.0:1782756254.499843:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c49779450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+21:10438:x1869355210025600:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:1.0:1782756254.500154:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c49779450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+22:10438:x1869355210025600:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 317us (794us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1782756254.500164:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 21 00000100:00100000:1.0:1782756254.540514:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756254.540617:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210025856 00000100:00100000:3.0:1782756254.540629:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210025856 00000100:00100000:3.0:1782756254.540731:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 88 00000100:00100000:3.0:1782756254.540743:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+22:9960:x1869355210025856:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:3.0:1782756254.540771:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756254.540791:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199220 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdfa5 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.540897:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199227 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.540912:0:6579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19920b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf9e expref: 23 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.540921:0:6579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199227 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.540960:0:6579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19920b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf9e expref: 23 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.540975:0:6579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19920b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf9e expref: 23 pid: 6579 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756254.540989:0:6579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fb4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6579:1869355222624640:192.168.204.25@tcp:104: 00000100:00100000:3.0:1782756254.541108:0:6579:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a1189c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782756254.544143:0:6579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fb4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6579:1869355222624640:192.168.204.25@tcp:104: 00010000:00010000:1.0:1782756254.544178:0:6579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199227 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756254.545681:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756254.545759:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210025984 00000100:00100000:2.0:1782756254.545769:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210025984 00010000:00010000:2.0:1782756254.545815:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19920b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf9e expref: 24 pid: 6579 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756254.545853:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 47 00000100:00100000:2.0:1782756254.545863:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fae3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+24:2356:x1869355210025984:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782756254.545880:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756254.545887:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19920b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf9e expref: 24 pid: 6579 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756254.545900:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19920b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf9e expref: 24 pid: 6579 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756254.545922:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa19920b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf9e expref: 24 pid: 6579 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756254.545940:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:2.0:1782756254.545945:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199227 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756254.545954:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199227 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756254.545962:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199227 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756254.545994:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756254.546054:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fae3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+23:2356:x1869355210025984:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 191us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756254.546123:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 47 00010000:00010000:1.0:1782756254.546550:0:6579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199227 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.546561:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199227 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756254.546583:0:6579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1782756254.546736:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199220 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfa5 expref: 24 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.546769:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199227 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfa5 expref: 23 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.546778:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:1.0:1782756254.546781:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782756254.546784:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168c400, rc 0) 00000100:00100000:1.0:1782756254.546816:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+23:9960:x1869355210025856:12345-192.168.204.25@tcp:101:bash.0 Request processed in 6077us (6313us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1782756254.546824:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 88 00000100:00100000:3.0:1782756254.559689:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756254.559824:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210026240 00000100:00100000:1.0:1782756254.559835:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210026240 00000100:00100000:1.0:1782756254.559945:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 89 00000100:00100000:1.0:1782756254.559965:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+23:9960:x1869355210026240:12345-192.168.204.25@tcp:36:bash.0 00010000:00010000:1.0:1782756254.560430:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199235 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.560447:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199235 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.560482:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199235 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782756254.560539:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1782756254.560581:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000085a8d937 reply state 00000000487145a3 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199235 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756254.560592:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1782756254.560643:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1782756254.560760:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+27:9960:x1869355210026240:12345-192.168.204.25@tcp:36:bash.0 Request processed in 805us (1081us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1782756254.560768:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 89 00000020:00080000:1.0:1782756254.560773:0:5803:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1782756254.563111:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199235 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756254.563127:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199235 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756254.563137:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199235 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756254.563143:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4400 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756254.563149:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199235 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756254.563156:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199235 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756254.563173:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:2.0:1782756254.563177:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756254.563182:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199235 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756254.563188:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199235 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756254.564664:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756254.565284:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210026368 00000100:00100000:1.0:1782756254.565294:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210026368 00000100:00100000:1.0:1782756254.565362:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 90 00000100:00100000:1.0:1782756254.565372:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+26:9960:x1869355210026368:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:1.0:1782756254.565398:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756254.565418:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa19923c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdfac expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.565494:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa19923c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfac expref: 27 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.565514:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa19923c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfac expref: 27 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.565535:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:1.0:1782756254.565566:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782756254.565570:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef5000, rc 0) 00000100:00100000:1.0:1782756254.565635:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+27:9960:x1869355210026368:12345-192.168.204.25@tcp:101:bash.0 Request processed in 263us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756254.565642:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 90 00000100:00100000:3.0:1782756254.570289:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756254.571838:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210026496 00000100:00100000:0.0:1782756254.571851:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210026496 00000100:00100000:0.0:1782756254.571950:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 33 00000100:00100000:0.0:1782756254.571962:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+6:9960:x1869355210026496:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:0.0:1782756254.571990:0:6602:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756254.572012:0:6602:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085ecaa65/0x5e4fb0a8aa199243 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdfb3 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782756254.572057:0:6602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a42b39a, atime: 0x6a42b399, ctime: 0x6a42b39a, blocks: 0xb 00010000:00010000:0.0:1782756254.572122:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=295s v=(0 0) 00010000:00010000:0.0:1782756254.572128:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782756254.572137:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085ecaa65/0x5e4fb0a8aa199243 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfb3 expref: 7 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.572156:0:6602:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000085ecaa65/0x5e4fb0a8aa199243 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfb3 expref: 7 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.572168:0:6602:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81b800, rc 0) 00000100:00100000:0.0:1782756254.572224:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+7:9960:x1869355210026496:12345-192.168.204.25@tcp:101:bash.0 Request processed in 265us (1944us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756254.572231:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 33 00000100:00080000:2.0:1782756254.572583:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782756254.580741:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756254.580818:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210026624 00000100:00100000:3.0:1782756254.580827:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210026624 00002000:00010000:3.0:1782756254.580866:0:6608:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1782756254.580871:0:6608:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3c78f85f80 with x1869355210026624 ext(0->18446744073709551615) 00002000:00010000:3.0:1782756254.580883:0:6608:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d3c78f85f80. 00000100:00100000:3.0:1782756254.580969:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1 00000100:00100000:3.0:1782756254.580979:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26487635-60cb-4aee-af8e-396654f6c3d8+7:2355:x1869355210026624:12345-192.168.204.25@tcp:10:bash.0 00002000:00010000:3.0:1782756254.581276:0:6608:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1782756254.581280:0:6608:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1782756250 -> 1782756254 00002000:00010000:3.0:1782756254.581283:0:6608:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1782756249 -> 1782756249 00002000:00010000:3.0:1782756254.581285:0:6608:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1782756250 -> 1782756254 00002000:00010000:3.0:1782756254.581288:0:6608:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1782756254.581522:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26487635-60cb-4aee-af8e-396654f6c3d8+8:2355:x1869355210026624:12345-192.168.204.25@tcp:10:bash.0 Request processed in 543us (788us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1782756254.581534:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1 00002000:00010000:2.0:1782756254.581551:0:6608:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1782756254.581553:0:6608:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3c78f85f80 with x1869355210026624 ext(0->18446744073709551615) 00002000:00010000:2.0:1782756254.581558:0:6608:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d3c78f85f80. 00000100:00100000:2.0:1782756254.628565:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756254.628678:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210026752 00000100:00100000:0.0:1782756254.628688:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210026752 00000100:00100000:0.0:1782756254.628741:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 91 00000100:00100000:0.0:1782756254.628751:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+27:10453:x1869355210026752:12345-192.168.204.25@tcp:34:lfs.0 00010000:00010000:0.0:1782756254.628831:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa19924a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.628850:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa19924a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.628861:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa19924a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.628894:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa199251 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.628901:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa199251 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.628908:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa199251 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.629225:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199258 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.629236:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.629243:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782756254.629280:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.629292:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa19924a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.629298:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa19924a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.629305:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa19924a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.629311:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81ae00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756254.629314:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa19924a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.629328:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa19924a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.629341:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:0.0:1782756254.629344:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756254.629349:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa19924a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.629354:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa19924a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.629366:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa199251 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.629372:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa199251 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.629378:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa199251 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.629383:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81b000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756254.629386:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa199251 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.629392:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa199251 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.629397:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d3c54288d00) 00010000:00010000:0.0:1782756254.629399:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756254.629401:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa199251 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.629415:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa199251 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.629428:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.629434:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199258 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.629440:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199258 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.629444:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81a200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756254.629460:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199258 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.629467:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199258 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.629475:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:0.0:1782756254.629477:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756254.629484:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199258 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.629490:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199258 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756254.629620:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+27:10453:x1869355210026752:12345-192.168.204.25@tcp:34:lfs.0 Request processed in 868us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756254.629628:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 91 00000100:00100000:3.0:1782756254.660614:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756254.661135:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210027008 00000100:00100000:1.0:1782756254.661146:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210027008 00000100:00100000:3.0:1782756254.661286:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 92 00000100:00100000:3.0:1782756254.661300:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+27:10456:x1869355210027008:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1782756254.661323:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756254.661352:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa19925f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdfba expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.661426:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199266 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.661441:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199266 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.661484:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199266 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.661499:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa19926d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.661506:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa19926d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.661513:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa19926d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.661817:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199274 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.661826:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199274 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.661833:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199274 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782756254.661843:0:6579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1782756254.662214:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199266 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.662222:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199266 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.662241:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199266 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.662248:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168cc00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756254.662258:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199266 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.662266:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199266 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.662278:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:3.0:1782756254.662281:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756254.662285:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199266 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.662292:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199266 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.662306:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa19926d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.662312:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa19926d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.662318:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa19926d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.662322:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168d200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756254.662325:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa19926d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.662331:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa19926d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.662337:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d3c49e15000) 00010000:00010000:3.0:1782756254.662339:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756254.662347:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa19926d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.662352:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa19926d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.662394:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa19925f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfba expref: 30 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.662407:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199274 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfba expref: 29 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.662415:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:3.0:1782756254.662418:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1782756254.662420:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168c200, rc 0) 00000100:00100000:3.0:1782756254.662496:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+29:10456:x1869355210027008:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1199us (1890us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1782756254.662505:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 92 00000100:00100000:2.0:1782756254.665673:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756254.666511:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210027136 00000100:00100000:1.0:1782756254.666523:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210027136 00000100:00100000:1.0:1782756254.666629:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 93 00000100:00100000:1.0:1782756254.666640:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+29:10456:x1869355210027136:12345-192.168.204.25@tcp:54:lfs.0 00010000:00010000:1.0:1782756254.666711:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa199282 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.666727:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199227 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfa5 expref: 29 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.666737:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa199282 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.666774:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199227 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfa5 expref: 29 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.666788:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199227 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfa5 expref: 29 pid: 6579 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756254.666804:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fae1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1869355222624768:192.168.204.25@tcp:104: 00000100:00100000:1.0:1782756254.666905:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c48f810c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782756254.669049:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fae1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1869355222624768:192.168.204.25@tcp:104: 00010000:00010000:1.0:1782756254.669114:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa199282 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756254.669613:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756254.669734:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210027392 00000100:00100000:1.0:1782756254.669741:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210027392 00000100:00100000:1.0:1782756254.669790:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 22 00000100:00100000:1.0:1782756254.669799:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+30:5578:x1869355210027392:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1782756254.670115:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+31:5578:x1869355210027392:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 315us (501us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1782756254.670124:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 22 00000100:00100000:2.0:1782756254.672058:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756254.672215:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210027520 00000100:00100000:0.0:1782756254.672224:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210027520 00010000:00010000:0.0:1782756254.672256:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199227 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfa5 expref: 31 pid: 6579 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756254.672293:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 48 00000100:00100000:0.0:1782756254.672302:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26487635-60cb-4aee-af8e-396654f6c3d8+31:2355:x1869355210027520:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782756254.672315:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756254.672321:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199227 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfa5 expref: 31 pid: 6579 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.672334:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199227 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfa5 expref: 31 pid: 6579 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.672355:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199227 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfa5 expref: 31 pid: 6579 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.672370:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:0.0:1782756254.672376:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa199282 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.672386:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa199282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.672394:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa199282 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.672423:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782756254.672564:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa199282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.672573:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa199282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.672599:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa199282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.672607:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa199282 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.672613:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa199282 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.672619:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756254.672624:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa199282 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.672632:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa199282 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.672656:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:1.0:1782756254.672659:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782756254.672663:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa199282 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.672669:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa199282 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756254.672723:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+30:10456:x1869355210027136:12345-192.168.204.25@tcp:54:lfs.0 Request processed in 6085us (7059us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756254.672732:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 93 00000100:00100000:0.0:1782756254.672774:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26487635-60cb-4aee-af8e-396654f6c3d8+29:2355:x1869355210027520:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 473us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756254.672786:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 48 00000100:00100000:3.0:1782756254.674559:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756254.674865:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210027776 00000100:00100000:0.0:1782756254.674875:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210027776 00000100:00100000:0.0:1782756254.674967:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 23 00000100:00100000:0.0:1782756254.674978:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+29:10456:x1869355210027776:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:0.0:1782756254.675231:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+30:10456:x1869355210027776:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 243us (667us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1782756254.675244:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 23 00000100:00100000:2.0:1782756254.736579:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756254.737722:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210028032 00000100:00100000:1.0:1782756254.737735:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210028032 00000100:00100000:1.0:1782756254.737851:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 94 00000100:00100000:1.0:1782756254.737862:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+30:10467:x1869355210028032:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1782756254.737888:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756254.737910:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa199289 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdfc1 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.737981:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199290 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.737995:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199290 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.738006:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199290 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.738020:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199297 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.738053:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199297 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.738061:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199297 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.738415:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa19929e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.738426:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa19929e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.738434:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa19929e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756254.738456:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1782756254.738564:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199290 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.738573:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199290 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.738580:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199290 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.738586:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5600 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756254.738590:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199290 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.738597:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199290 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.738619:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:1.0:1782756254.738623:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756254.738627:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199290 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.738634:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199290 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.738647:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199297 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.738654:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199297 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.738660:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199297 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.738665:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5c00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756254.738668:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199297 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.738674:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199297 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.738681:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d3c4ef38800) 00010000:00010000:1.0:1782756254.738683:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756254.738686:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199297 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.738692:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199297 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.738749:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa199289 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfc1 expref: 33 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.738765:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa19929e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfc1 expref: 32 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.738773:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:1.0:1782756254.738775:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782756254.738778:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef4000, rc 0) 00000100:00100000:1.0:1782756254.738910:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+32:10467:x1869355210028032:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1049us (2340us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1782756254.738919:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 94 00000100:00100000:2.0:1782756254.744258:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756254.744384:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210028288 00000100:00100000:1.0:1782756254.744396:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210028288 00000100:00100000:1.0:1782756254.745397:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 24 00000100:00100000:1.0:1782756254.745413:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+32:10467:x1869355210028288:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1782756254.745894:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+33:10467:x1869355210028288:12345-192.168.204.25@tcp:35:cat.0 Request processed in 485us (1644us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1782756254.745903:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 24 00000100:00100000:0.0:1782756254.767194:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756254.768427:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210028544 00000100:00100000:1.0:1782756254.768439:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210028544 00000100:00100000:1.0:1782756254.768515:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 95 00000100:00100000:1.0:1782756254.768526:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+33:10468:x1869355210028544:12345-192.168.204.25@tcp:36:rm.0 00010000:00010000:1.0:1782756254.768587:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1782756254.768617:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa19929e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfc1 expref: 33 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.768653:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199274 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfba expref: 32 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.768669:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa19923c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfac expref: 31 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.768678:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:1.0:1782756254.768689:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782756254.768709:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1992ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.768722:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1992ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.768731:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1992ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.768745:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1992b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.768753:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1992b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.768759:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1992b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.769055:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1992ba lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.769064:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1992ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.769103:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1992ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782756254.771522:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1782756254.771538:0:5804:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 296006461810ns, next at 297006458328ns, rc = 0 00010000:00010000:1.0:1782756254.771621:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1992c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.771635:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1992c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.771646:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1992c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.771655:0:5804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1992c1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.771661:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1992c1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.771667:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1992c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.771692:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782756254.771715:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1992ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.771721:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1992ba lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.771726:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1992ba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.771740:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5600 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756254.771744:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1992ba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.771752:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1992ba lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.771765:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c4ef38e00) 00010000:00010000:1.0:1782756254.771767:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782756254.771772:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1992ba lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.771778:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1992ba lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.771796:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1992ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.771802:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1992ac lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.771808:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1992ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.771812:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756254.771815:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1992ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.771821:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1992ac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.771841:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:1.0:1782756254.771844:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756254.771847:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1992ac lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.771853:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1992ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782756254.771863:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a1d5b10f reply state 000000001722ab8e transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1992b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756254.771874:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782756254.771973:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+32:10468:x1869355210028544:12345-192.168.204.25@tcp:36:rm.0 Request processed in 3445us (4783us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1782756254.771982:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 95 00010000:00010000:2.0:1782756254.772251:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782756254.772257:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1992c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756254.772264:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5a00 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:2.0:1782756254.772268:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1992c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756254.772276:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1992c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756254.772285:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d3c4ef38e00) 00010000:00010000:2.0:1782756254.772288:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782756254.772292:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1992c1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756254.772298:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1992c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756254.772313:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756254.772315:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756254.772317:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756254.773661:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1992b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.773674:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1992b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.773680:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1992b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.774009:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5c00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756254.774013:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1992b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.774031:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1992b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.774044:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d3c4ef38800) 00010000:00010000:3.0:1782756254.774047:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756254.774050:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1992b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.774057:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1992b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756254.814421:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756254.814683:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210028800 00000100:00100000:3.0:1782756254.814693:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210028800 00000100:00100000:3.0:1782756254.814796:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 96 00000100:00100000:3.0:1782756254.814807:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+31:10474:x1869355210028800:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:3.0:1782756254.814834:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756254.814854:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa1992c8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdfc8 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.815094:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa1992cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.815111:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa1992cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.815123:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa1992cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.815138:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa1992d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.815161:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa1992d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.815229:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa1992d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782756254.815745:0:6579:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1782756254.815900:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1992dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.815911:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1992dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.815920:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1992dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.816023:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa1992cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.816030:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa1992cf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.816037:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa1992cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.816043:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168d200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756254.816047:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa1992cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.816055:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa1992cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.816106:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:3.0:1782756254.816110:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756254.816115:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa1992cf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.816122:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa1992cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782756254.816137:0:6579:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000efbbf627 reply state 000000006d75cae3 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa1992d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756254.816146:0:6579:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782756254.816237:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa1992c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfc8 expref: 34 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.816254:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1992dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfc8 expref: 33 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.816262:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c49e15e00) 00010000:00010000:3.0:1782756254.816264:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782756254.816267:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168d600, rc 0) 00000100:00100000:3.0:1782756254.816388:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+34:10474:x1869355210028800:12345-192.168.204.25@tcp:101:bash.0 Request processed in 1582us (1976us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1782756254.816396:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 96 00000100:00100000:2.0:1782756254.823977:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756254.824055:0:10416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210028928 00000100:00100000:0.0:1782756254.824065:0:10416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210028928 00000100:00100000:0.0:1782756254.824133:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 34 00000100:00100000:0.0:1782756254.824143:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+7:2355:x1869355210028928:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:0.0:1782756254.824162:0:10416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756254.824193:0:10416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb776ad3/0x5e4fb0a8aa1992eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdfcf expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782756254.824221:0:10416:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782756254.824240:0:10416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=296s v=(0 0) 00010000:00010000:0.0:1782756254.824244:0:10416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782756254.824255:0:10416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb776ad3/0x5e4fb0a8aa1992eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfcf expref: 8 pid: 10416 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.824275:0:10416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cb776ad3/0x5e4fb0a8aa1992eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfcf expref: 8 pid: 10416 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.824300:0:10416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81b000, rc 0) 00000100:00100000:0.0:1782756254.824364:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+8:2355:x1869355210028928:12345-192.168.204.25@tcp:101:bash.0 Request processed in 222us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756254.824371:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 34 00000100:00080000:2.0:1782756254.824468:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782756254.824692:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa1992d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.824702:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa1992d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.824709:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa1992d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.824715:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168cc00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756254.824720:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa1992d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.824728:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa1992d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.824847:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d3c49e15000) 00010000:00010000:1.0:1782756254.824851:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756254.824856:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa1992d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756254.824863:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa1992d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756254.828549:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756254.828682:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210029056 00000100:00100000:0.0:1782756254.828693:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210029056 00000100:00100000:0.0:1782756254.828758:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 35 00000100:00100000:0.0:1782756254.828768:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+8:10474:x1869355210029056:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:0.0:1782756254.828787:0:6602:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756254.828803:0:6602:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa1992f2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdfd6 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.828833:0:6602:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb776ad3/0x5e4fb0a8aa1992eb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfcf expref: 9 pid: 10416 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.828841:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782756254.828846:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782756254.828851:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa1992f2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfd6 expref: 9 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.828885:0:6602:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cb776ad3/0x5e4fb0a8aa1992eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfcf expref: 9 pid: 10416 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756254.828901:0:6602:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cb776ad3/0x5e4fb0a8aa1992eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfcf expref: 9 pid: 10416 timeout: 396 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756254.828931:0:6602:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76f8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6602:1869355222624896:192.168.204.25@tcp:104: 00000100:00100000:0.0:1782756254.829390:0:6602:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76d17600 going to sleep for 11 seconds 00000100:00100000:0.0:1782756254.833219:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756254.833407:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210029184 00000100:00100000:2.0:1782756254.833416:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210029184 00010000:00010000:2.0:1782756254.833470:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cb776ad3/0x5e4fb0a8aa1992eb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfcf expref: 10 pid: 10416 timeout: 396 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756254.833515:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 49 00000100:00100000:2.0:1782756254.833525:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c501d6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+10:2355:x1869355210029184:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782756254.833541:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756254.833563:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cb776ad3/0x5e4fb0a8aa1992eb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfcf expref: 10 pid: 10416 timeout: 396 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756254.833579:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cb776ad3/0x5e4fb0a8aa1992eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfcf expref: 10 pid: 10416 timeout: 396 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756254.833608:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756254.833613:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756254.833622:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa1992f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfd6 expref: 10 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756254.833632:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa1992f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfd6 expref: 10 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756254.833670:0:5788:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa1992f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfd6 expref: 10 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756254.833707:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78f84000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5788:1869355222625024:192.168.204.25@tcp:105: 00000100:00100000:2.0:1782756254.833794:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76d85600 going to sleep for 11 seconds 00010000:00010000:3.0:1782756254.834672:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb776ad3/0x5e4fb0a8aa1992eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfcf expref: 10 pid: 10416 timeout: 396 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756254.834689:0:6602:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76f8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6602:1869355222624896:192.168.204.25@tcp:104: 00010000:00010000:3.0:1782756254.834724:0:6602:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa1992f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfd6 expref: 9 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756254.834735:0:6602:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81aa00, rc 0) 00000100:00100000:0.0:1782756254.834952:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+9:10474:x1869355210029056:12345-192.168.204.25@tcp:101:bash.0 Request processed in 6184us (6409us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756254.834961:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 35 00000100:00100000:2.0:1782756254.837380:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78f84000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5788:1869355222625024:192.168.204.25@tcp:105: 00010000:00010000:2.0:1782756254.837405:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756254.837586:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c501d6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+8:2355:x1869355210029184:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4059us (4374us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756254.837597:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 49 00000100:00100000:2.0:1782756254.838720:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756254.839680:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210029440 00000100:00100000:0.0:1782756254.839690:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210029440 00000100:00100000:0.0:1782756254.839783:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 25 00000100:00100000:0.0:1782756254.839794:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+33:10474:x1869355210029440:12345-192.168.204.25@tcp:35:bash.0 00000100:00100000:0.0:1782756254.840184:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+34:10474:x1869355210029440:12345-192.168.204.25@tcp:35:bash.0 Request processed in 390us (1466us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1782756254.840192:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 25 00000100:00100000:1.0:1782756255.035266:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756255.035385:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756255.037406:0:10416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210029696 00000100:00100000:0.0:1782756255.037418:0:10416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210029696 00000100:00100000:0.0:1782756255.037496:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 36 00000100:00100000:0.0:1782756255.037506:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+8:2357:x1869355210029696:12345-192.168.204.25@tcp:16:kworker.0 00000100:00100000:0.0:1782756255.037656:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+8:2357:x1869355210029696:12345-192.168.204.25@tcp:16:kworker.0 Request processed in 151us (2270us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756255.037664:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 36 00000100:00100000:3.0:1782756255.042169:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210029568 00000100:00100000:3.0:1782756255.042184:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210029568 00002000:00100000:3.0:1782756255.042245:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9d3c7fae1f80 x1869355210029568/t0(0) o4->26487635-60cb-4aee-af8e-396654f6c3d8@192.168.204.25@tcp:436/0 lens 504/0 e 0 to 0 dl 1782756266 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782756255.042256:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3c7fae1f80 with x1869355210029568 ext(0->8) 00002000:00010000:3.0:1782756255.042262:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d3c7fae1f80 00000100:00100000:3.0:1782756255.042305:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 2 00000100:00100000:3.0:1782756255.042315:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26487635-60cb-4aee-af8e-396654f6c3d8+8:2357:x1869355210029568:12345-192.168.204.25@tcp:4:bash.0 00000100:00100000:3.0:1782756255.042841:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26487635-60cb-4aee-af8e-396654f6c3d8+10:2357:x1869355210029568:12345-192.168.204.25@tcp:4:bash.0 Request processed in 525us (7583us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1782756255.042851:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 2 00002000:00100000:3.0:1782756255.042859:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9d3c7fae1f80 x1869355210029568/t4294967302(0) o4->26487635-60cb-4aee-af8e-396654f6c3d8@192.168.204.25@tcp:436/0 lens 504/448 e 0 to 0 dl 1782756266 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782756255.042866:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3c7fae1f80 with x1869355210029568 ext(0->8) 00002000:00010000:3.0:1782756255.042869:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d3c7fae1f80 00000100:00100000:1.0:1782756255.045521:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756255.045886:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210029824 00000100:00100000:0.0:1782756255.045895:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210029824 00000100:00100000:0.0:1782756255.046004:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 97 00000100:00100000:0.0:1782756255.046016:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+34:10490:x1869355210029824:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1782756255.046053:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756255.046092:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1992f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdfdd expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756255.046175:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa199300 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756255.046188:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa199300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756255.046198:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa199300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782756255.046257:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1782756255.046260:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782756255.046281:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa199300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782756255.046476:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782756255.046513:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1992f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfdd expref: 36 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756255.046534:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa199300 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfdd expref: 35 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756255.046543:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:0.0:1782756255.046546:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782756255.046550:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81a000, rc 0) 00000100:00100000:0.0:1782756255.046619:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+35:10490:x1869355210029824:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 597us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756255.046627:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 97 00000100:00100000:2.0:1782756255.049945:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756255.050107:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210030080 00000100:00100000:1.0:1782756255.050118:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210030080 00000100:00100000:1.0:1782756255.050177:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 98 00000100:00100000:1.0:1782756255.050187:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+35:10490:x1869355210030080:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1782756255.050206:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756255.050226:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199307 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdfe4 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.050337:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa19930e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.050351:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa19930e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.050362:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa19930e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756255.050373:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1782756255.050532:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199307 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfe4 expref: 38 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.050550:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa19930e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfe4 expref: 37 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.050558:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c49e15e00) 00010000:00010000:1.0:1782756255.050562:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782756255.050565:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef4600, rc 0) 00000100:00100000:1.0:1782756255.051059:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+37:10490:x1869355210030080:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 871us (1120us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1782756255.051067:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 98 00000100:00100000:2.0:1782756255.056497:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756255.056541:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756255.056613:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210030208 00000100:00100000:3.0:1782756255.056624:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210030208 00000100:00100000:3.0:1782756255.056690:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6 00000100:00100000:3.0:1782756255.056701:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+37:2356:x1869355210030208:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782756255.056717:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756255.056767:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa19930e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfe4 expref: 37 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.056787:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c49e15e00) 00010000:00010000:3.0:1782756255.056792:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782756255.056850:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+36:2356:x1869355210030208:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 151us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756255.056857:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6 00000100:00100000:1.0:1782756255.057332:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210030464 00000100:00100000:1.0:1782756255.057338:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210030464 00000100:00100000:1.0:1782756255.057369:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 99 00000100:00100000:1.0:1782756255.057377:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+36:10490:x1869355210030464:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1782756255.057396:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756255.057412:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa19931c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdfeb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.057522:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199323 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.057536:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199323 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.057546:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199323 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756255.057571:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1782756255.057696:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa19931c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfeb expref: 39 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.057712:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199323 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfeb expref: 38 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.057720:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c49e15e00) 00010000:00010000:1.0:1782756255.057723:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1782756255.057725:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef5800, rc 0) 00000100:00100000:1.0:1782756255.057852:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+38:10490:x1869355210030464:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 475us (1309us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1782756255.057859:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 99 00000100:00100000:2.0:1782756255.067257:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756255.067347:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210030592 00000100:00100000:1.0:1782756255.067358:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210030592 00000100:00100000:1.0:1782756255.067414:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 37 00000100:00100000:1.0:1782756255.067424:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+10:2355:x1869355210030592:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:1.0:1782756255.067487:0:6603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fccb89b/0x5e4fb0a8aa199331 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.067506:0:6603:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa1992f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfd6 expref: 10 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.067514:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756255.067518:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782756255.067523:0:6603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fccb89b/0x5e4fb0a8aa199331 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.067570:0:6603:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa1992f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfd6 expref: 10 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.067583:0:6603:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa1992f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfd6 expref: 10 pid: 6602 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756255.067597:0:6603:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fae0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6603:1869355222625152:192.168.204.25@tcp:104: 00000100:00100000:1.0:1782756255.068217:0:6603:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a700840 going to sleep for 11 seconds 00000100:00100000:2.0:1782756255.071793:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756255.071961:0:6603:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fae0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6603:1869355222625152:192.168.204.25@tcp:104: 00010000:00010000:0.0:1782756255.071988:0:6603:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002fccb89b/0x5e4fb0a8aa199331 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756255.072109:0:8367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210030720 00000100:00100000:3.0:1782756255.072116:0:8367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210030720 00010000:00010000:3.0:1782756255.072151:0:8367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa1992f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfd6 expref: 11 pid: 6602 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756255.072187:0:8367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 50 00000100:00100000:3.0:1782756255.072197:0:8367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26487635-60cb-4aee-af8e-396654f6c3d8+11:2355:x1869355210030720:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782756255.072212:0:8367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1782756255.072228:0:8367:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1782756255.072231:0:8367:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1782756254 00002000:00010000:3.0:1782756255.072234:0:8367:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1782756254 00010000:00010000:3.0:1782756255.072240:0:8367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa1992f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfd6 expref: 11 pid: 6602 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.072252:0:8367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa1992f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfd6 expref: 11 pid: 6602 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.072276:0:8367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa1992f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfd6 expref: 11 pid: 6602 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.072323:0:8367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782756255.072327:0:8367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782756255.072333:0:8367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002fccb89b/0x5e4fb0a8aa199331 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.072342:0:8367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fccb89b/0x5e4fb0a8aa199331 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.072462:0:8367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782756255.072518:0:8367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26487635-60cb-4aee-af8e-396654f6c3d8+10:2355:x1869355210030720:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 321us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756255.072527:0:8367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 50 00010000:00010000:0.0:1782756255.074276:0:6603:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002fccb89b/0x5e4fb0a8aa199331 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756255.074291:0:6603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fccb89b/0x5e4fb0a8aa199331 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756255.074333:0:6603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fccb89b/0x5e4fb0a8aa199331 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756255.074343:0:6603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fccb89b/0x5e4fb0a8aa199331 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756255.074351:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fccb89b/0x5e4fb0a8aa199331 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756255.074358:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4800 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:0.0:1782756255.074362:0:6603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fccb89b/0x5e4fb0a8aa199331 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756255.074371:0:6603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fccb89b/0x5e4fb0a8aa199331 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756255.074406:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fccb89b/0x5e4fb0a8aa199331 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756255.074413:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fccb89b/0x5e4fb0a8aa199331 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756255.074662:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+9:2355:x1869355210030592:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 7235us (7411us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756255.074671:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 37 00000100:00100000:2.0:1782756255.078177:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756255.078265:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210030976 00000100:00100000:1.0:1782756255.078275:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210030976 00000100:00100000:1.0:1782756255.078335:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 26 00000100:00100000:1.0:1782756255.078345:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c49779c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+38:10490:x1869355210030976:12345-192.168.204.25@tcp:35:lfs.0 00000004:00010000:1.0:1782756255.078410:0:5807:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199323 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfeb expref: 38 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782756255.078665:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1782756255.078711:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1782756255.079025:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1782756255.079116:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199338 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.079131:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1992dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfc8 expref: 42 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.079139:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199338 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.079191:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1992dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfc8 expref: 42 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.079204:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1992dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfc8 expref: 42 pid: 6579 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756255.079218:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fae2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5807:1869355222625280:192.168.204.25@tcp:104: 00000100:00100000:1.0:1782756255.079291:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c48f81900 going to sleep for 11 seconds 00000100:00100000:1.0:1782756255.081665:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fae2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5807:1869355222625280:192.168.204.25@tcp:104: 00010000:00010000:1.0:1782756255.081702:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199338 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756255.083430:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756255.083658:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210031104 00000100:00100000:3.0:1782756255.083668:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210031104 00010000:00010000:3.0:1782756255.083718:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1992dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfc8 expref: 43 pid: 6579 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756255.083761:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 51 00000100:00100000:3.0:1782756255.083771:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+43:2355:x1869355210031104:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782756255.083786:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756255.083793:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1992dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfc8 expref: 43 pid: 6579 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.083804:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1992dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfc8 expref: 43 pid: 6579 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.083847:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1992dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfc8 expref: 43 pid: 6579 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.083865:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c49e15e00) 00010000:00010000:3.0:1782756255.083870:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199338 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.083880:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199338 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.083887:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199338 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.083917:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782756255.083969:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+42:2355:x1869355210031104:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 199us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756255.083977:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 51 00010000:00010000:1.0:1782756255.084463:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199338 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.084473:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199338 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782756255.084598:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1782756255.084818:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1782756255.084929:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fae2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1869355222625408:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1782756255.084981:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756255.085062:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78a50240 going to sleep for 11 seconds 00000100:00100000:0.0:1782756255.086746:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222625408 00000100:00100000:0.0:1782756255.086756:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222625408 00000100:00080000:2.0:1782756255.086881:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782756255.087016:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782756255.087027:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5807:x1869355222625408:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782756255.087154:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5807:x1869355222625408:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 129us (2171us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756255.087161:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782756255.087255:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fae2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1869355222625408:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1782756255.087784:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1782756255.087864:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fae2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1869355222625536:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1782756255.087913:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756255.088593:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c48f81900 going to sleep for 11 seconds 00000100:00100000:3.0:1782756255.088961:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222625536 00000100:00100000:3.0:1782756255.088968:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222625536 00000100:00100000:3.0:1782756255.089005:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782756255.089015:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5807:x1869355222625536:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1782756255.089611:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5807:x1869355222625536:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 595us (1694us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1782756255.089619:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782756255.089828:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fae2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1869355222625536:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1782756255.089895:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1782756255.089941:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199338 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.089953:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199338 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.089959:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199338 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.089965:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756255.089969:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199338 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.089977:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199338 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.089993:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c49e15e00) 00010000:00010000:1.0:1782756255.089996:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1782756255.090000:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199338 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.090006:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199338 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782756255.090225:0:5807:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1782756255.090435:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1782756255.090706:0:5807:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 296325630373ns, next at 297325627371ns, rc = 0 00000001:00080000:1.0:1782756255.090844:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1782756255.090888:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c49e15e00) 00010000:00010000:1.0:1782756255.090892:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1782756255.090901:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199323 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfeb expref: 46 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756255.091061:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c49779c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+45:10490:x1869355210030976:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 12716us (12891us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1782756255.091071:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 26 00000020:00080000:1.0:1782756255.091098:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1782756255.093945:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756255.094029:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210031232 00000100:00100000:3.0:1782756255.094038:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210031232 00000100:00100000:1.0:1782756255.094266:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 100 00000100:00100000:1.0:1782756255.094278:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+45:10490:x1869355210031232:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1782756255.094313:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756255.094338:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa19933f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdff2 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.094395:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa19933f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdff2 expref: 46 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.094411:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa19933f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdff2 expref: 46 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.094430:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:1.0:1782756255.094433:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782756255.094437:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef5e00, rc 0) 00000100:00100000:1.0:1782756255.094750:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+46:10490:x1869355210031232:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 473us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756255.094772:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 100 00000100:00100000:0.0:1782756255.097768:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756255.097999:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210031488 00000100:00100000:1.0:1782756255.098008:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210031488 00000100:00100000:1.0:1782756255.098065:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 27 00000100:00100000:1.0:1782756255.098097:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+46:10490:x1869355210031488:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:1.0:1782756255.098323:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+47:10490:x1869355210031488:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 248us (562us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1782756255.098330:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 27 00010000:00010000:2.0:1782756255.180869:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782756255.219354:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756255.220983:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210031616 00000100:00100000:1.0:1782756255.220996:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210031616 00000100:00100000:1.0:1782756255.221061:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 101 00000100:00100000:1.0:1782756255.221093:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+47:10500:x1869355210031616:12345-192.168.204.25@tcp:34:lfs.0 00010000:00010000:1.0:1782756255.221188:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199346 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.221206:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199346 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.221218:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199346 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.221234:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa19934d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.221242:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa19934d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.221249:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa19934d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.221372:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa199354 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.221381:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa199354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.221389:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa199354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782756255.221431:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa199354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.221455:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199346 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.221462:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199346 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.221469:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199346 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.221476:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5800 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756255.221479:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199346 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.221487:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199346 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.221498:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:1.0:1782756255.221501:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756255.221506:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199346 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.221519:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199346 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.221532:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa19934d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.221538:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa19934d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.221543:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa19934d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.221547:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756255.221550:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa19934d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.221556:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa19934d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.221563:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d3c4ef38800) 00010000:00010000:1.0:1782756255.221566:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756255.221569:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa19934d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.221574:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa19934d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.221588:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa199354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.221607:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa199354 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.221620:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa199354 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.221625:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4800 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756255.221628:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa199354 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.221634:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa199354 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.221641:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:1.0:1782756255.221644:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756255.221647:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa199354 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.221652:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa199354 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756255.221931:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+47:10500:x1869355210031616:12345-192.168.204.25@tcp:34:lfs.0 Request processed in 858us (2585us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756255.221940:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 101 00000001:00080000:0.0:1782756255.245033:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:0.0:1782756255.245051:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:0.0:1782756255.245057:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1782756255.245061:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1782756255.292026:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756255.292243:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210031872 00000100:00100000:1.0:1782756255.292255:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210031872 00000100:00100000:1.0:1782756255.292378:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 102 00000100:00100000:1.0:1782756255.292388:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76f8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+47:10503:x1869355210031872:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1782756255.292411:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756255.292431:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa19935b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6cdff9 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.292537:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199362 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.292551:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199362 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.292562:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199362 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.292576:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199369 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.292583:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199369 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.292815:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199369 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.293020:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa199370 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.293030:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa199370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.293037:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa199370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756255.293048:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1782756255.293961:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199362 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.293979:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199362 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.293987:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199362 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.293994:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756255.293999:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199362 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.294006:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199362 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.294019:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:3.0:1782756255.294022:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756255.294027:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199362 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.294033:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa199362 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.294048:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199369 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.294055:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199369 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.294061:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199369 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.294067:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5800 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756255.294120:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199369 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.294128:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199369 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.294136:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d3c4ef38800) 00010000:00010000:3.0:1782756255.294139:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756255.294142:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199369 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.294147:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199369 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.294444:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa19935b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdff9 expref: 50 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.294525:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa199370 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdff9 expref: 49 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.294533:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:3.0:1782756255.294535:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782756255.294538:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef5000, rc 0) 00000100:00100000:3.0:1782756255.294916:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76f8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+49:10503:x1869355210031872:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2527us (2900us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1782756255.294925:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 102 00000100:00100000:1.0:1782756255.299587:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756255.299873:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210032000 00000100:00100000:0.0:1782756255.299941:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210032000 00000100:00100000:0.0:1782756255.300030:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 103 00000100:00100000:0.0:1782756255.300039:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+49:10503:x1869355210032000:12345-192.168.204.25@tcp:54:lfs.0 00010000:00010000:0.0:1782756255.300148:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa19937e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756255.300223:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa19937e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756255.300236:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa19937e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756255.300260:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa19937e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756255.300267:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa19937e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756255.300275:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa19937e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756255.300281:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81be00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756255.300285:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa19937e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756255.300291:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa19937e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756255.301046:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:0.0:1782756255.301050:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782756255.301055:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa19937e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756255.301062:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa19937e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756255.301466:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+49:10503:x1869355210032000:12345-192.168.204.25@tcp:54:lfs.0 Request processed in 1426us (1886us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756255.301476:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 103 00000100:00100000:2.0:1782756255.305457:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756255.305558:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210032256 00000100:00100000:1.0:1782756255.305569:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210032256 00000100:00100000:1.0:1782756255.305832:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 28 00000100:00100000:1.0:1782756255.305843:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+49:10503:x1869355210032256:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:1.0:1782756255.306120:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+50:10503:x1869355210032256:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 278us (684us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1782756255.306128:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 28 00000100:00100000:2.0:1782756255.389274:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756255.389785:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210032512 00000100:00100000:1.0:1782756255.389795:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210032512 00000100:00100000:1.0:1782756255.389894:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 104 00000100:00100000:1.0:1782756255.389906:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+50:10513:x1869355210032512:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:1.0:1782756255.389931:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756255.389934:0:6579:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782756255.389959:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa199300 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfdd expref: 50 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.389979:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:1.0:1782756255.389984:0:6579:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782756255.389997:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199385 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce000 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.390148:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19938c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.390162:0:6579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa199370 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdff9 expref: 50 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.390171:0:6579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19938c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.390225:0:6579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa199370 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdff9 expref: 50 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.390237:0:6579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa199370 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdff9 expref: 50 pid: 5805 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756255.390251:0:6579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fae2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6579:1869355222625664:192.168.204.25@tcp:104: 00000100:00100000:1.0:1782756255.390352:0:6579:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c49170600 going to sleep for 11 seconds 00000100:00100000:0.0:1782756255.394225:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756255.394979:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210032640 00000100:00100000:2.0:1782756255.394991:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210032640 00010000:00010000:2.0:1782756255.395038:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa199370 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdff9 expref: 51 pid: 5805 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756255.395173:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 52 00000100:00100000:2.0:1782756255.395184:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+51:2355:x1869355210032640:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782756255.395198:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756255.395205:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa199370 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdff9 expref: 51 pid: 5805 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756255.395218:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa199370 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdff9 expref: 51 pid: 5805 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756255.395241:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:2.0:1782756255.395247:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19938c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756255.395256:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19938c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756255.395262:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19938c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756255.395282:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756255.395353:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+51:2355:x1869355210032640:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 171us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756255.395362:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 52 00010000:00010000:1.0:1782756255.396059:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa199370 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdff9 expref: 50 pid: 5805 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756255.396102:0:6579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fae2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6579:1869355222625664:192.168.204.25@tcp:104: 00010000:00010000:1.0:1782756255.396125:0:6579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19938c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.396894:0:6579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19938c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.396905:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19938c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756255.396926:0:6579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1782756255.397072:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199385 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce000 expref: 51 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.397122:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19938c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce000 expref: 50 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.397158:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:1.0:1782756255.397161:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782756255.397164:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef5200, rc 0) 00000100:00100000:1.0:1782756255.397213:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+50:10513:x1869355210032512:12345-192.168.204.25@tcp:101:bash.0 Request processed in 7310us (7949us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1782756255.397221:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 104 00000100:00100000:0.0:1782756255.400235:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756255.400305:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210032896 00000100:00100000:1.0:1782756255.400315:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210032896 00000100:00100000:1.0:1782756255.400370:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 105 00000100:00100000:1.0:1782756255.400381:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+50:10513:x1869355210032896:12345-192.168.204.25@tcp:36:bash.0 00010000:00010000:1.0:1782756255.400766:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa19939a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.400783:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa19939a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.400795:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa19939a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782756255.400846:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1782756255.400870:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002c0ae0f2 reply state 00000000ee428d62 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa19939a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756255.400879:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782756255.400975:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+53:10513:x1869355210032896:12345-192.168.204.25@tcp:36:bash.0 Request processed in 595us (745us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1782756255.400982:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 105 00000020:00080000:1.0:1782756255.400998:0:5803:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1782756255.404154:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756255.404697:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210033024 00000100:00100000:2.0:1782756255.404708:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210033024 00000100:00100000:2.0:1782756255.404822:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 106 00000100:00100000:2.0:1782756255.404833:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+53:10513:x1869355210033024:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:2.0:1782756255.404866:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756255.404886:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa1993a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce007 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756255.404961:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1993a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756255.404975:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19938c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce000 expref: 54 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756255.404983:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa19939a lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756255.404991:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1993a8 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756255.405007:0:5805:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa19939a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756255.405030:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19938c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce000 expref: 54 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756255.405044:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19938c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce000 expref: 54 pid: 6579 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756255.405057:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78f86300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869355222625792:192.168.204.25@tcp:104: 00000100:00100000:2.0:1782756255.405240:0:5805:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c46950240 going to sleep for 11 seconds 00010000:00010000:3.0:1782756255.409553:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa19939a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.409569:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa19939a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.409590:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa19939a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.409597:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5c00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756255.409602:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa19939a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.409609:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa19939a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.409626:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:3.0:1782756255.409630:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756255.409634:0:3300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1993a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.409644:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa19939a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.409650:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa19939a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756255.409779:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756255.409931:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78f86300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869355222625792:192.168.204.25@tcp:104: 00010000:00010000:2.0:1782756255.409965:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1993a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756255.410267:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210033152 00000100:00100000:3.0:1782756255.410274:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210033152 00010000:00010000:3.0:1782756255.410302:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19938c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce000 expref: 54 pid: 6579 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756255.410335:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 53 00000100:00100000:3.0:1782756255.410343:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+54:2356:x1869355210033152:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782756255.410357:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756255.410368:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19938c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce000 expref: 54 pid: 6579 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.410380:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19938c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce000 expref: 54 pid: 6579 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.410399:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19938c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce000 expref: 54 pid: 6579 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.410409:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:3.0:1782756255.410413:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1993a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.410421:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1993a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.410428:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1993a8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756255.410465:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782756255.410512:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+53:2356:x1869355210033152:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 169us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756255.410519:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 53 00010000:00010000:2.0:1782756255.410666:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1993a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756255.410675:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1993a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756255.410717:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1782756255.410721:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782756255.410739:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1993a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756255.410766:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa1993a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce007 expref: 53 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756255.410781:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1993a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce007 expref: 52 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756255.410788:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:2.0:1782756255.410791:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782756255.410794:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63d200, rc 0) 00000100:00100000:2.0:1782756255.410829:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+52:10513:x1869355210033024:12345-192.168.204.25@tcp:101:bash.0 Request processed in 5999us (6687us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756255.410847:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 106 00000100:00100000:0.0:1782756255.415409:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756255.418836:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210033408 00000100:00100000:3.0:1782756255.418851:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210033408 00000100:00100000:2.0:1782756255.424458:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 29 00000100:00100000:2.0:1782756255.424480:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+52:10513:x1869355210033408:12345-192.168.204.25@tcp:35:bash.0 00000100:00100000:2.0:1782756255.424731:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+53:10513:x1869355210033408:12345-192.168.204.25@tcp:35:bash.0 Request processed in 260us (9330us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1782756255.424761:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 29 00000100:00100000:3.0:1782756255.495464:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756255.495668:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210033536 00000100:00100000:1.0:1782756255.495678:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210033536 00000100:00100000:1.0:1782756255.495746:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 107 00000100:00100000:1.0:1782756255.495756:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+53:10519:x1869355210033536:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1782756255.495781:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756255.495812:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1993af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce00e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.495876:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1993b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.495890:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1993b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.495902:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1993b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756255.495970:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1782756255.495974:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1782756255.495998:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1993b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.496022:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1993af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce00e expref: 55 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.496040:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1993b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce00e expref: 54 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.496049:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:1.0:1782756255.496067:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782756255.496071:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef5000, rc 0) 00000100:00100000:1.0:1782756255.496178:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+54:10519:x1869355210033536:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 424us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756255.496186:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 107 00000100:00100000:2.0:1782756255.504876:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756255.504955:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210033664 00000100:00100000:1.0:1782756255.504966:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210033664 00000100:00100000:1.0:1782756255.505026:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 108 00000100:00100000:1.0:1782756255.505035:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+54:10519:x1869355210033664:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1782756255.505056:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756255.505106:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa1993bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce015 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.505191:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1993c4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.505206:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1993c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.505414:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1993c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.505448:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1993cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.505799:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1993cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.505808:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1993cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.505917:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1993d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.505937:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1993d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.505946:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1993d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756255.505981:0:6579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1782756255.505985:0:6579:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782756255.506003:0:6579:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1993d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.506015:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1993d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.506023:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1993c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.506029:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1993c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.506035:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1993c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.506042:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4c00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756255.506046:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1993c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.506054:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1993c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.506103:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:1.0:1782756255.506107:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756255.506112:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1993c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.506119:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1993c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.506133:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1993cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.506139:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1993cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.506144:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1993cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.506150:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756255.506153:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1993cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.506158:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1993cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.506165:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d3c4ef38e00) 00010000:00010000:1.0:1782756255.506168:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756255.506171:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1993cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.506177:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1993cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.506219:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa1993bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce015 expref: 56 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.507867:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1993d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce015 expref: 55 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.507876:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:1.0:1782756255.507879:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782756255.507882:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef4e00, rc 0) 00000100:00100000:1.0:1782756255.507959:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+55:10519:x1869355210033664:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2923us (3091us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756255.507968:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 108 00000100:00100000:3.0:1782756255.525480:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756255.525664:0:8367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210033792 00000100:00100000:0.0:1782756255.525673:0:8367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210033792 00000100:00100000:0.0:1782756255.525745:0:8367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7 00000100:00100000:0.0:1782756255.525756:0:8367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26487635-60cb-4aee-af8e-396654f6c3d8+55:2356:x1869355210033792:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782756255.525772:0:8367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756255.525796:0:8367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1993d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce015 expref: 55 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756255.525814:0:8367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:0.0:1782756255.525820:0:8367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756255.525879:0:8367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26487635-60cb-4aee-af8e-396654f6c3d8+54:2356:x1869355210033792:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 124us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756255.525886:0:8367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7 00000100:00100000:3.0:1782756255.533638:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756255.533787:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210034048 00000100:00100000:1.0:1782756255.533799:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210034048 00000100:00100000:1.0:1782756255.533859:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 109 00000100:00100000:1.0:1782756255.533869:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+54:10519:x1869355210034048:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1782756255.533889:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756255.533911:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa1993d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce01c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.534011:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1993e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.534024:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1993a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce007 expref: 55 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.534033:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1993e0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.534122:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1993a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce007 expref: 55 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.534137:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1993a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce007 expref: 55 pid: 5805 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756255.534151:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fae2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1869355222625920:192.168.204.25@tcp:104: 00000100:00100000:1.0:1782756255.534244:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c540c6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782756255.542597:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fae2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1869355222625920:192.168.204.25@tcp:104: 00010000:00010000:1.0:1782756255.542629:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1993e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756255.543268:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756255.543533:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210034176 00000100:00100000:2.0:1782756255.543541:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210034176 00010000:00010000:2.0:1782756255.543579:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1993a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce007 expref: 56 pid: 5805 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756255.543619:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 54 00000100:00100000:2.0:1782756255.543630:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c501d6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+56:2356:x1869355210034176:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782756255.543645:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756255.543652:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1993a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce007 expref: 56 pid: 5805 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756255.543665:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1993a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce007 expref: 56 pid: 5805 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756255.543688:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1993a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce007 expref: 56 pid: 5805 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756255.543707:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:2.0:1782756255.543712:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1993e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756255.543731:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1993e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756255.543738:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1993e0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756255.543783:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756255.543836:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c501d6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+55:2356:x1869355210034176:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 207us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756255.543844:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 54 00010000:00010000:1.0:1782756255.543981:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1993e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.543990:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1993e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756255.544008:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1782756255.544190:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa1993d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce01c expref: 56 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.544205:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1993e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce01c expref: 55 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756255.544213:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:1.0:1782756255.544215:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782756255.544224:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef4200, rc 0) 00000100:00100000:1.0:1782756255.544249:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+55:10519:x1869355210034048:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 10381us (10620us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1782756255.544256:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 109 00000100:00100000:3.0:1782756255.549014:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756255.550239:0:8367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210034432 00000100:00100000:0.0:1782756255.550250:0:8367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210034432 00000100:00100000:0.0:1782756255.550327:0:8367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8 00000100:00100000:0.0:1782756255.550337:0:8367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26487635-60cb-4aee-af8e-396654f6c3d8+55:10519:x1869355210034432:12345-192.168.204.25@tcp:103:lfs.0 00010000:00010000:0.0:1782756255.550367:0:8367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756255.550394:0:8367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa19933f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdff2 expref: 55 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756255.550412:0:8367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:0.0:1782756255.550417:0:8367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756255.550492:0:8367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26487635-60cb-4aee-af8e-396654f6c3d8+54:10519:x1869355210034432:12345-192.168.204.25@tcp:103:lfs.0 Request processed in 157us (1486us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756255.550500:0:8367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8 00000100:00100000:3.0:1782756255.556983:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756255.557102:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210034560 00000100:00100000:2.0:1782756255.557111:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210034560 00000100:00100000:2.0:1782756255.557165:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 110 00000100:00100000:2.0:1782756255.557179:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+54:10519:x1869355210034560:12345-192.168.204.25@tcp:58:lfs.0 00010000:00010000:2.0:1782756255.557400:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1993ee lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756255.557416:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1993ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756255.557439:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1993ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782756255.557637:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1782756255.557769:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+54:10519:x1869355210034560:12345-192.168.204.25@tcp:58:lfs.0 Request processed in 594us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756255.557777:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 110 00000100:00100000:3.0:1782756255.559956:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756255.560159:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210034688 00000100:00100000:0.0:1782756255.560167:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210034688 00000100:00100000:0.0:1782756255.560216:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 111 00000100:00100000:0.0:1782756255.560644:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+54:10519:x1869355210034688:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1782756255.560665:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756255.560685:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa1993f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce023 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756255.560746:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1993ee lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756255.560758:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa1993f5 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce023 expref: 55 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756255.560777:0:5804:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1993ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756255.560789:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa1993f5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce023 expref: 55 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756255.560822:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:0.0:1782756255.560826:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782756255.560830:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa1993f5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce023 expref: 55 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756255.560838:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81ae00, rc 0) 00000100:00100000:0.0:1782756255.560896:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+55:10519:x1869355210034688:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 260us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756255.560904:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 111 00000040:00080000:0.0:1782756256.140510:0:11537:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782756256.140521:0:11537:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782756256.140705:0:11537:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1782756256.140713:0:11537:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782756256.141273:0:11537:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76f8ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11537:1869355222626048:192.168.204.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782756256.141703:0:11537:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76d17d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782756256.147780:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756256.147875:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210034816 00000100:00100000:1.0:1782756256.147885:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210034816 00000100:00100000:1.0:1782756256.147951:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 112 00000100:00100000:1.0:1782756256.147962:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+56:10520:x1869355210034816:12345-192.168.204.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782756256.147996:0:6579:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782756256.148129:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+56:10520:x1869355210034816:12345-192.168.204.25@tcp:53:lhsmtool_posix.0 Request processed in 168us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756256.148137:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 112 00000100:00100000:0.0:1782756256.148393:0:11537:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76f8ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11537:1869355222626048:192.168.204.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782756256.151414:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756256.151550:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210034944 00000100:00100000:1.0:1782756256.151559:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210034944 00000100:00100000:1.0:1782756256.151673:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 113 00000100:00100000:1.0:1782756256.151685:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+55:10520:x1869355210034944:12345-192.168.204.25@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1782756256.151760:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa1993fc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.151790:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa1993fc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.151805:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa1993fc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.151887:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199403 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.151895:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199403 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.151916:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199403 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.151940:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19940a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.151948:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19940a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.151956:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19940a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756256.151992:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1782756256.151997:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782756256.152008:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19940a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.152019:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa1993fc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.152026:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa1993fc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.152033:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa1993fc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.152039:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4400 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756256.152043:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa1993fc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.152051:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa1993fc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.152071:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3c54288100) 00010000:00010000:1.0:1782756256.152106:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756256.152111:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa1993fc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.152118:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa1993fc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.152133:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199403 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.152139:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199403 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.152145:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199403 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.152150:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4c00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756256.152152:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199403 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.152158:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199403 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.152166:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9d3c4ef38e00) 00010000:00010000:1.0:1782756256.152169:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756256.152172:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199403 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.152177:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199403 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.152200:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19940a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.152207:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19940a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.152217:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19940a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.152222:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5600 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756256.152225:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19940a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.152231:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19940a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.152239:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:1.0:1782756256.152241:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756256.152244:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19940a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.152250:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19940a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756256.152402:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+55:10520:x1869355210034944:12345-192.168.204.25@tcp:34:lhsmtool_posix.0 Request processed in 719us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756256.152410:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 113 00000100:00100000:3.0:1782756256.154635:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756256.154681:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210035200 00000100:00100000:1.0:1782756256.154689:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210035200 00000100:00100000:1.0:1782756256.154748:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 114 00000100:00100000:1.0:1782756256.154773:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+55:10520:x1869355210035200:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782756256.154791:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756256.154810:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5400/0x5e4fb0a8aa199411 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce02a expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.154904:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa199418 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.154920:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa199418 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.154932:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa199418 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756256.154944:0:6579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1782756256.155046:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa199418 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.155053:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa199418 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.155060:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa199418 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.155065:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5e00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756256.155069:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa199418 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.155099:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa199418 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.155110:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:1.0:1782756256.155139:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782756256.155144:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa199418 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.155149:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa199418 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.155180:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5400/0x5e4fb0a8aa199411 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce02a expref: 57 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.155187:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3c54288100) 00010000:00010000:1.0:1782756256.155189:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782756256.155191:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5400/0x5e4fb0a8aa199411 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce02a expref: 57 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.155197:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef5400, rc 0) 00000100:00100000:1.0:1782756256.155244:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+56:10520:x1869355210035200:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 474us (618us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1782756256.155251:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 114 00000100:00100000:3.0:1782756256.157269:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756256.157338:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210035328 00000100:00100000:0.0:1782756256.157347:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210035328 00000100:00100000:0.0:1782756256.157399:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 115 00000100:00100000:0.0:1782756256.157409:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+56:10520:x1869355210035328:12345-192.168.204.25@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782756256.157465:0:5804:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782756256.157559:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+56:10520:x1869355210035328:12345-192.168.204.25@tcp:53:lhsmtool_posix.0 Request processed in 151us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756256.157566:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 115 00000100:00100000:3.0:1782756256.161667:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756256.161779:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210035584 00000100:00100000:2.0:1782756256.161789:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210035584 00000100:00100000:2.0:1782756256.161876:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 116 00000100:00100000:2.0:1782756256.161887:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+56:10520:x1869355210035584:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782756256.161909:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756256.161912:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782756256.161945:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1993b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce00e expref: 56 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.161963:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:2.0:1782756256.161967:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782756256.161980:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa199426 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce031 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782756256.162503:0:5805:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1782756256.162726:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19942d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.162739:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19942d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.162748:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19942d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.162813:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa199426 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce031 expref: 58 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.162835:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19942d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce031 expref: 57 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.162843:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d3c58212900) 00010000:00010000:2.0:1782756256.162846:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782756256.162849:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63cc00, rc 0) 00000100:00100000:2.0:1782756256.162920:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+57:10520:x1869355210035584:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 1034us (1373us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1782756256.162942:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 116 00000100:00100000:3.0:1782756256.168336:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756256.168498:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210035840 00000100:00100000:1.0:1782756256.168508:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210035840 00000100:00100000:1.0:1782756256.168567:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 117 00000100:00100000:1.0:1782756256.168577:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+57:10520:x1869355210035840:12345-192.168.204.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782756256.168752:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756256.168781:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19942d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce031 expref: 57 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.168801:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d3c58212900) 00010000:00010000:1.0:1782756256.168829:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782756256.168849:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19943b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.168862:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19943b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.168871:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19943b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.168936:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199442 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xdc831068 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.168943:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199442 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xdc831068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.168950:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199442 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xdc831068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.169021:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19943b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.169029:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19943b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.169035:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19943b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.169041:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5600 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756256.169046:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19943b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.169054:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19943b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.169070:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:1.0:1782756256.169240:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756256.169247:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19943b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.169253:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19943b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.169264:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199442 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xdc831068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.169270:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199442 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xdc831068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.169275:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199442 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xdc831068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.169281:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4c00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756256.169284:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199442 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xdc831068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.169291:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199442 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xdc831068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.169299:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xdc831068 (ffff9d3c4ef38e00) 00010000:00010000:1.0:1782756256.169301:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756256.169304:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199442 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xdc831068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.169310:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199442 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xdc831068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756256.170721:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+56:10520:x1869355210035840:12345-192.168.204.25@tcp:36:lhsmtool_posix.0 Request processed in 2128us (2377us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782756256.170733:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 117 00000100:00100000:3.0:1782756256.181867:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756256.181957:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210035968 00000100:00100000:1.0:1782756256.181967:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210035968 00000100:00100000:1.0:1782756256.182042:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 118 00000100:00100000:1.0:1782756256.182052:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+56:10520:x1869355210035968:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782756256.182103:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756256.182126:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199449 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce038 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.182172:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199450 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.182187:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199450 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.182202:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199450 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.182341:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa199449 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce038 expref: 58 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.182366:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199450 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce038 expref: 57 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.182376:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d3c4ef38e00) 00010000:00010000:1.0:1782756256.182388:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782756256.182393:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef5600, rc 0) 00000100:00100000:1.0:1782756256.182480:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+57:10520:x1869355210035968:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 427us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756256.182489:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 118 00000100:00100000:3.0:1782756256.192541:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756256.192747:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210036224 00000100:00100000:0.0:1782756256.192758:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210036224 00000100:00100000:0.0:1782756256.192826:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 119 00000100:00100000:0.0:1782756256.192836:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+57:10520:x1869355210036224:12345-192.168.204.25@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782756256.192931:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199457 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.192948:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199457 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.192960:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199457 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782756256.193324:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1782756256.193334:0:5804:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 297428258780ns, next at 298428255852ns, rc = 0 00000004:00010000:0.0:1782756256.193449:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000009f1630 reply state 00000000a815cb3d transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199457 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756256.193460:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782756256.193571:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+59:10520:x1869355210036224:12345-192.168.204.25@tcp:36:lhsmtool_posix.0 Request processed in 736us (1039us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1782756256.193578:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 119 00010000:00010000:1.0:1782756256.196950:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199457 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.196968:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199457 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.196975:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199457 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.196981:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81a200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756256.196986:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199457 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.196994:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199457 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.197011:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d3c4ef38e00) 00010000:00010000:1.0:1782756256.197015:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782756256.197020:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199457 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.197025:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199457 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756256.197829:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756256.197900:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210036352 00000100:00100000:2.0:1782756256.197911:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210036352 00000100:00100000:2.0:1782756256.197968:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 120 00000100:00100000:2.0:1782756256.197979:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+58:10520:x1869355210036352:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782756256.198003:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756256.198021:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19945e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce03f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.198130:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19945e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce03f expref: 59 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.198149:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19945e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce03f expref: 59 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.198173:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d3c4ef38e00) 00010000:00010000:2.0:1782756256.198177:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782756256.198180:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63d000, rc 0) 00000100:00100000:2.0:1782756256.198256:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+59:10520:x1869355210036352:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 278us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756256.198266:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 120 00000100:00100000:3.0:1782756256.202321:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756256.202434:0:10416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210036480 00000100:00100000:0.0:1782756256.202446:0:10416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210036480 00000100:00100000:0.0:1782756256.202543:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 38 00000100:00100000:0.0:1782756256.202553:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+8:2356:x1869355210036480:12345-192.168.204.25@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1782756256.202885:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+9:2356:x1869355210036480:12345-192.168.204.25@tcp:2:lhsmtool_posix.0 Request processed in 332us (573us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1782756256.202893:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 38 00000100:00080000:2.0:1782756256.202980:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782756256.205371:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782756256.209684:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756256.210334:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210036736 00000100:00100000:1.0:1782756256.210347:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210036736 00000100:00100000:1.0:1782756256.210471:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 30 00000100:00100000:1.0:1782756256.210484:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+59:10520:x1869355210036736:12345-192.168.204.25@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1782756256.210769:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+60:10520:x1869355210036736:12345-192.168.204.25@tcp:35:lhsmtool_posix.0 Request processed in 288us (1094us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1782756256.210777:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 30 00000100:00100000:1.0:1782756256.214290:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756256.214580:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210036992 00000100:00100000:0.0:1782756256.214590:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210036992 00000100:00100000:0.0:1782756256.214648:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 121 00000100:00100000:0.0:1782756256.214659:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+60:10520:x1869355210036992:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782756256.214891:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+60:10520:x1869355210036992:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 Request processed in 233us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756256.214899:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 121 00000100:00100000:3.0:1782756256.217917:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756256.218426:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210037120 00000100:00100000:2.0:1782756256.218436:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210037120 00000100:00100000:2.0:1782756256.218787:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 122 00000100:00100000:2.0:1782756256.218798:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+60:10520:x1869355210037120:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782756256.218835:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756256.218857:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa199465 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce046 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.218932:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19946c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.219067:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19946c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.219098:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19946c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756256.219134:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782756256.219151:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19946c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.219178:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa199465 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce046 expref: 62 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.219199:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19946c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce046 expref: 61 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.219207:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d3c4ef38e00) 00010000:00010000:2.0:1782756256.219210:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1782756256.219214:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63de00, rc 0) 00000100:00100000:2.0:1782756256.219371:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+61:10520:x1869355210037120:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 575us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756256.219379:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 122 00000100:00100000:3.0:1782756256.222687:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756256.222835:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210037248 00000100:00100000:0.0:1782756256.222845:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210037248 00000100:00100000:0.0:1782756256.222935:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 39 00000100:00100000:0.0:1782756256.223011:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+9:2355:x1869355210037248:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782756256.223029:0:6602:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756256.223051:0:6602:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005383d368/0x5e4fb0a8aa199473 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce04d expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782756256.223096:0:6602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a42b39f, blocks: 0x1 00010000:00010000:0.0:1782756256.223114:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=297s v=(0 0) 00010000:00010000:0.0:1782756256.223119:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782756256.223129:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005383d368/0x5e4fb0a8aa199473 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce04d expref: 10 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.223146:0:6602:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005383d368/0x5e4fb0a8aa199473 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce04d expref: 10 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.223158:0:6602:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81a200, rc 0) 00000100:00100000:0.0:1782756256.223259:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+10:2355:x1869355210037248:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 315us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756256.223293:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 39 00000100:00100000:1.0:1782756256.226778:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756256.226900:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210037504 00000100:00100000:2.0:1782756256.226910:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210037504 00000100:00100000:2.0:1782756256.226977:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 123 00000100:00100000:2.0:1782756256.226988:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+61:10520:x1869355210037504:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782756256.227127:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+61:10520:x1869355210037504:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 Request processed in 141us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756256.227135:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 123 00000100:00100000:2.0:1782756256.231798:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756256.231886:0:10416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210037632 00000100:00100000:0.0:1782756256.231895:0:10416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210037632 00000100:00100000:0.0:1782756256.231960:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 40 00000100:00100000:0.0:1782756256.231971:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+10:10520:x1869355210037632:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782756256.231989:0:10416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756256.232009:0:10416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7380b48/0x5e4fb0a8aa19947a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce054 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.232039:0:10416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005383d368/0x5e4fb0a8aa199473 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce04d expref: 11 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.232048:0:10416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782756256.232053:0:10416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782756256.232057:0:10416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7380b48/0x5e4fb0a8aa19947a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce054 expref: 11 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.232125:0:10416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005383d368/0x5e4fb0a8aa199473 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce04d expref: 11 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.232140:0:10416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005383d368/0x5e4fb0a8aa199473 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce04d expref: 11 pid: 6602 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756256.232154:0:10416:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76f8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10416:1869355222626176:192.168.204.25@tcp:104: 00000100:00100000:0.0:1782756256.232238:0:10416:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76d17540 going to sleep for 11 seconds 00000100:00100000:3.0:1782756256.235880:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756256.235976:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210037760 00000100:00100000:2.0:1782756256.235985:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210037760 00010000:00010000:2.0:1782756256.236024:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005383d368/0x5e4fb0a8aa199473 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce04d expref: 12 pid: 6602 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756256.236070:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 55 00000100:00100000:2.0:1782756256.236110:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+12:2355:x1869355210037760:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782756256.236128:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756256.236151:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005383d368/0x5e4fb0a8aa199473 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce04d expref: 12 pid: 6602 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.236166:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005383d368/0x5e4fb0a8aa199473 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce04d expref: 12 pid: 6602 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.236194:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756256.236198:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756256.236206:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7380b48/0x5e4fb0a8aa19947a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce054 expref: 12 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.236233:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7380b48/0x5e4fb0a8aa19947a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce054 expref: 12 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.236269:0:5789:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d7380b48/0x5e4fb0a8aa19947a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce054 expref: 12 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756256.236296:0:5789:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78f87b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5789:1869355222626304:192.168.204.25@tcp:105: 00000100:00100000:2.0:1782756256.236374:0:5789:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a700240 going to sleep for 11 seconds 00010000:00010000:0.0:1782756256.236847:0:10416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005383d368/0x5e4fb0a8aa199473 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce04d expref: 12 pid: 6602 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756256.236863:0:10416:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76f8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10416:1869355222626176:192.168.204.25@tcp:104: 00010000:00010000:0.0:1782756256.236887:0:10416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d7380b48/0x5e4fb0a8aa19947a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce054 expref: 11 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.236898:0:10416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81a000, rc 0) 00000100:00100000:0.0:1782756256.236948:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+11:10520:x1869355210037632:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 4972us (5153us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756256.236956:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 40 00000100:00100000:3.0:1782756256.242510:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756256.242618:0:5789:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78f87b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5789:1869355222626304:192.168.204.25@tcp:105: 00010000:00010000:2.0:1782756256.242643:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756256.242703:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+10:2355:x1869355210037760:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6596us (6832us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756256.242723:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 55 00000100:00100000:0.0:1782756256.243122:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210037888 00000100:00100000:0.0:1782756256.243129:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210037888 00002000:00100000:0.0:1782756256.243175:0:6608:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9d3c78f8ed80 x1869355210037888/t0(0) o4->26487635-60cb-4aee-af8e-396654f6c3d8@192.168.204.25@tcp:437/0 lens 504/0 e 0 to 0 dl 1782756267 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782756256.243185:0:6608:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3c78f8ed80 with x1869355210037888 ext(0->12) 00002000:00010000:0.0:1782756256.243190:0:6608:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d3c78f8ed80 00000100:00100000:0.0:1782756256.243215:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3 00000100:00100000:0.0:1782756256.243224:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26487635-60cb-4aee-af8e-396654f6c3d8+10:2355:x1869355210037888:12345-192.168.204.25@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1782756256.243662:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26487635-60cb-4aee-af8e-396654f6c3d8+12:2355:x1869355210037888:12345-192.168.204.25@tcp:4:lhsmtool_posix.0 Request processed in 437us (1161us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1782756256.243669:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3 00002000:00100000:0.0:1782756256.243676:0:6608:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9d3c78f8ed80 x1869355210037888/t4294967308(0) o4->26487635-60cb-4aee-af8e-396654f6c3d8@192.168.204.25@tcp:437/0 lens 504/448 e 0 to 0 dl 1782756267 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782756256.243696:0:6608:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3c78f8ed80 with x1869355210037888 ext(0->12) 00002000:00010000:0.0:1782756256.243700:0:6608:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d3c78f8ed80 00000100:00100000:3.0:1782756256.246804:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756256.246903:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210038016 00000100:00100000:1.0:1782756256.246913:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210038016 00000100:00100000:1.0:1782756256.246969:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 124 00000100:00100000:1.0:1782756256.246980:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+61:10520:x1869355210038016:12345-192.168.204.25@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1782756256.277291:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+61:10520:x1869355210038016:12345-192.168.204.25@tcp:44:lhsmtool_posix.0 Request processed in 30293us (30476us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756256.277305:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 124 00000001:00080000:3.0:1782756256.277344:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:3.0:1782756256.277350:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000001:00080000:3.0:1782756256.277382:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1782756256.277400:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1782756256.277432:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d3c78a50540 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1782756256.277436:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d3c4b99d300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d3c78a50240 00000020:00080000:3.0:1782756256.277440:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d3c4b99dc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d3c80fa7c00 00000004:00080000:3.0:1782756256.277477:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1782756256.277510:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d3c469500c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1782756256.277513:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d3c4b909d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d3c46950900 00000020:00080000:3.0:1782756256.277515:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d3c4b909700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d3c76f85400 00000020:00080000:3.0:1782756256.277522:0:5825:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1782756256.278124:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1782756256.278306:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1782756256.278327:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78f84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222626560:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1782756256.278391:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756256.278461:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782756256.278469:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78f87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222626432:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782756256.278494:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756256.278525:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222626560 00000100:00100000:2.0:1782756256.278533:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222626560 00000100:00100000:2.0:1782756256.278578:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222626432 00000100:00100000:2.0:1782756256.278582:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222626432 00000100:00100000:2.0:1782756256.278612:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1782756256.278620:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3315:x1869355222626560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1782756256.281269:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76f8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222626688:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782756256.281452:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756256.281592:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00010000:2.0:1782756256.281933:0:6603:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1782756256.281937:0:6603:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1782756255 00002000:00010000:2.0:1782756256.281940:0:6603:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1782756256.281942:0:6603:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1782756255 -> 1782756255 00002000:00010000:2.0:1782756256.281944:0:6603:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1782756256.282032:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3315:x1869355222626560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3411us (3639us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1782756256.282042:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1782756256.282062:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222626688 00000100:00100000:2.0:1782756256.282067:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222626688 00000100:00100000:2.0:1782756256.282105:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210038144 00000100:00100000:2.0:1782756256.282109:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210038144 00000100:00100000:2.0:1782756256.282126:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782756256.282134:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79df9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3315:x1869355222626432:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782756256.282158:0:6603:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1782756256.282176:0:6603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199481 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.282194:0:6603:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000085ecaa65/0x5e4fb0a8aa199243 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfb3 expref: 12 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.282203:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782756256.282207:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782756256.282211:0:6603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199481 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.282258:0:6603:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000085ecaa65/0x5e4fb0a8aa199243 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfb3 expref: 12 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.282272:0:6603:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000085ecaa65/0x5e4fb0a8aa199243 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfb3 expref: 12 pid: 6602 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756256.282297:0:6603:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c79df8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6603:1869355222626816:192.168.204.25@tcp:104: 00000100:00100000:2.0:1782756256.282369:0:6603:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76d853c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782756256.282390:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782756256.282397:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222626688:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782756256.282411:0:10416:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:2.0:1782756256.282449:0:10416:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a42b39e, atime: 0x0, ctime: 0x6a42b39e, blocks: 0xb 00010000:00010000:2.0:1782756256.282454:0:10416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa199488 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.282462:0:10416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=297s v=(0 0) 00010000:00010000:2.0:1782756256.282465:0:10416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756256.282471:0:10416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa199488 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.282484:0:10416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa199488 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.282493:0:10416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa199488 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.282506:0:10416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa199488 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.282522:0:10416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782756256.283135:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3316:x1869355222626688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 736us (1681us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1782756256.283143:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782756256.283161:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 44 00000100:00100000:2.0:1782756256.283169:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+12:2356:x1869355210038144:12345-192.168.204.25@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1782756256.283215:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782756256.283222:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa199488 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.283230:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d800 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:2.0:1782756256.283235:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa199488 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.283245:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa199488 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.283264:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa199488 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.283271:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa199488 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.283299:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756256.283301:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756256.283303:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782756256.283339:0:3316:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1782756256.283345:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:2.0:1782756256.283365:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d3c7fb9d180, transno 4294967301 00000004:00080000:2.0:1782756256.283374:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:2.0:1782756256.283391:0:3316:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9d3c76f8ce00 x1869355222626688/t4294967304(4294967304) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1782756272 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1782756256.283402:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d3c76f8ce00/2, rc 0, transno 4294967304 00000100:00100000:2.0:1782756256.283408:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76f8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222626688:0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1782756256.283489:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1782756256.286487:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d3c78f84a80/2, rc 0, transno 4294967309 00000100:00100000:0.0:1782756256.286503:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78f84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222626560:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1782756256.291048:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756256.291166:0:6603:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c79df8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6603:1869355222626816:192.168.204.25@tcp:104: 00010000:00010000:0.0:1782756256.291194:0:6603:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199481 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756256.292025:0:8367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210038272 00000100:00100000:1.0:1782756256.292033:0:8367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210038272 00010000:00010000:1.0:1782756256.292069:0:8367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000085ecaa65/0x5e4fb0a8aa199243 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfb3 expref: 13 pid: 6602 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756256.292140:0:8367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 56 00000100:00100000:1.0:1782756256.292149:0:8367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79df9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26487635-60cb-4aee-af8e-396654f6c3d8+13:2356:x1869355210038272:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782756256.292164:0:8367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756256.292169:0:8367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000085ecaa65/0x5e4fb0a8aa199243 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfb3 expref: 13 pid: 6602 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.292181:0:8367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000085ecaa65/0x5e4fb0a8aa199243 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfb3 expref: 13 pid: 6602 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.292225:0:8367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085ecaa65/0x5e4fb0a8aa199243 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdfb3 expref: 13 pid: 6602 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.292241:0:8367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782756256.292245:0:8367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782756256.292250:0:8367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199481 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.292259:0:8367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199481 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.292465:0:8367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782756256.292519:0:8367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79df9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26487635-60cb-4aee-af8e-396654f6c3d8+12:2356:x1869355210038272:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 370us (1482us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756256.292527:0:8367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 56 00010000:00010000:0.0:1782756256.292662:0:6603:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199481 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.292672:0:6603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199481 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.292683:0:6603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199481 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.292691:0:6603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199481 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.292719:0:6603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782756256.293251:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79df9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3315:x1869355222626432:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11116us (14755us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1782756256.293266:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:0.0:1782756256.293337:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d3c78f87b80/2, rc 0, transno 4294967310 00000100:00100000:0.0:1782756256.293345:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78f87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222626432:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782756256.293563:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782756256.293571:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199481 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.293580:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63c000 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:1.0:1782756256.293585:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199481 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.293594:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199481 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.293621:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199481 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.293629:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199481 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.293648:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756256.293650:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756256.293652:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782756256.320182:0:6627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:1.0:1782756256.320208:0:6627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:2.0:1782756256.320510:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+6:2356:x1869355210038144:12345-192.168.204.25@tcp:16:lhsmtool_posix.0 Request processed in 37336us (38915us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756256.320523:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 44 00000100:00100000:2.0:1782756256.324008:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756256.324147:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210038528 00000100:00100000:1.0:1782756256.324157:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210038528 00000100:00100000:1.0:1782756256.324244:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 125 00000100:00100000:1.0:1782756256.324253:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79df8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+15:10520:x1869355210038528:12345-192.168.204.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782756256.324316:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756256.324343:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19946c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce046 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.324363:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d3c4ef38e00) 00010000:00010000:1.0:1782756256.324368:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782756256.324403:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa19948f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.324429:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa19948f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.324572:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa19948f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782756256.324900:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000ac9ca75 reply state 00000000ec8973de transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa19948f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756256.324910:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782756256.325010:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79df8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+16:10520:x1869355210038528:12345-192.168.204.25@tcp:36:lhsmtool_posix.0 Request processed in 756us (1008us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1782756256.325018:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 125 00000100:00100000:3.0:1782756256.327584:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1782756256.328200:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa19948f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.328213:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa19948f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.328220:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa19948f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.328226:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5800 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756256.328230:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa19948f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.328253:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa19948f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.328269:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d3c4ef38e00) 00010000:00010000:2.0:1782756256.328272:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756256.328276:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa19948f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.328282:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa19948f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756256.328401:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210038656 00000100:00100000:0.0:1782756256.328410:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210038656 00000100:00100000:0.0:1782756256.328596:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 45 00000100:00100000:0.0:1782756256.328609:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+6:2355:x1869355210038656:12345-192.168.204.25@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1782756256.328836:0:6605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1782756256.328840:0:6605:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1782756255 -> 1782756254 00002000:00010000:0.0:1782756256.328842:0:6605:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1782756254 00002000:00010000:0.0:1782756256.328844:0:6605:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1782756255 -> 1782756254 00002000:00010000:0.0:1782756256.328846:0:6605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1782756256.328926:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+7:2355:x1869355210038656:12345-192.168.204.25@tcp:2:lhsmtool_posix.0 Request processed in 319us (1351us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1782756256.328933:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 45 00000100:00100000:0.0:1782756256.331393:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756256.331474:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210038912 00000100:00100000:2.0:1782756256.331483:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210038912 00000100:00100000:2.0:1782756256.331537:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 126 00000100:00100000:2.0:1782756256.331547:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+15:10520:x1869355210038912:12345-192.168.204.25@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1782756256.331610:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa199496 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.331626:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199450 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce038 expref: 15 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.331636:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa199496 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.331667:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199450 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce038 expref: 15 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.331679:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199450 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce038 expref: 15 pid: 6579 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756256.331720:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c79dfbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869355222626944:192.168.204.25@tcp:104: 00000100:00100000:2.0:1782756256.331814:0:5805:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76d85b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782756256.334773:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756256.334868:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c79dfbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869355222626944:192.168.204.25@tcp:104: 00010000:00010000:3.0:1782756256.334892:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa199496 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756256.335411:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210039040 00000100:00100000:0.0:1782756256.335429:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210039040 00010000:00010000:0.0:1782756256.335470:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199450 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce038 expref: 16 pid: 6579 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756256.335507:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 57 00000100:00100000:0.0:1782756256.335517:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26487635-60cb-4aee-af8e-396654f6c3d8+16:2355:x1869355210039040:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782756256.335533:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756256.335541:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199450 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce038 expref: 16 pid: 6579 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.335567:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199450 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce038 expref: 16 pid: 6579 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.335591:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa199450 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce038 expref: 16 pid: 6579 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.335609:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d3c4ef38e00) 00010000:00010000:0.0:1782756256.335614:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa199496 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.335622:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa199496 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.335630:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa199496 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.335658:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756256.335725:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26487635-60cb-4aee-af8e-396654f6c3d8+15:2355:x1869355210039040:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 208us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756256.335733:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 57 00010000:00010000:3.0:1782756256.335791:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa199496 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756256.335799:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa199496 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756256.335828:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa199496 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756256.335836:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa199496 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756256.335843:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa199496 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756256.335849:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63c800 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756256.335852:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa199496 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756256.335870:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa199496 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756256.335880:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d3c4ef38e00) 00010000:00010000:3.0:1782756256.335883:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1782756256.335887:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa199496 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756256.335892:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa199496 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756256.335945:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+14:10520:x1869355210038912:12345-192.168.204.25@tcp:55:lhsmtool_posix.0 Request processed in 4399us (4559us total) trans 0 rc -22/-22 00000100:00100000:3.0:1782756256.335952:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 126 00000100:00100000:2.0:1782756256.343796:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756256.343862:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210039168 00000100:00100000:0.0:1782756256.343870:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210039168 00000100:00100000:0.0:1782756256.343918:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 46 00000100:00100000:0.0:1782756256.343925:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79df9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+7:2356:x1869355210039168:12345-192.168.204.25@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1782756256.343963:0:6603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009eb17432/0x5e4fb0a8aa19949d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.343993:0:6603:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7380b48/0x5e4fb0a8aa19947a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce054 expref: 7 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.343999:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782756256.344002:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782756256.344005:0:6603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eb17432/0x5e4fb0a8aa19949d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.344033:0:6603:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d7380b48/0x5e4fb0a8aa19947a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce054 expref: 7 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.344042:0:6603:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d7380b48/0x5e4fb0a8aa19947a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce054 expref: 7 pid: 10416 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756256.344052:0:6603:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76f8d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6603:1869355222627072:192.168.204.25@tcp:104: 00000100:00100000:0.0:1782756256.344149:0:6603:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76d17300 going to sleep for 11 seconds 00000100:00100000:2.0:1782756256.346335:0:6603:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76f8d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6603:1869355222627072:192.168.204.25@tcp:104: 00010000:00010000:2.0:1782756256.346365:0:6603:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009eb17432/0x5e4fb0a8aa19949d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756256.346946:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756256.347996:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210039296 00000100:00100000:0.0:1782756256.348006:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210039296 00010000:00010000:2.0:1782756256.348166:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d7380b48/0x5e4fb0a8aa19947a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce054 expref: 8 pid: 10416 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756256.348209:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 58 00000100:00100000:2.0:1782756256.348220:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+8:2355:x1869355210039296:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782756256.348236:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756256.348259:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d7380b48/0x5e4fb0a8aa19947a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce054 expref: 8 pid: 10416 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.348384:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d7380b48/0x5e4fb0a8aa19947a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce054 expref: 8 pid: 10416 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.348425:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7380b48/0x5e4fb0a8aa19947a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce054 expref: 8 pid: 10416 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.348462:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782756256.348467:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782756256.348472:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009eb17432/0x5e4fb0a8aa19949d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.348482:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eb17432/0x5e4fb0a8aa19949d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.348549:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756256.348607:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+7:2355:x1869355210039296:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 389us (1662us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756256.348616:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 58 00010000:00010000:0.0:1782756256.349498:0:6603:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009eb17432/0x5e4fb0a8aa19949d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.349511:0:6603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009eb17432/0x5e4fb0a8aa19949d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.349540:0:6603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009eb17432/0x5e4fb0a8aa19949d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.349559:0:6603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009eb17432/0x5e4fb0a8aa19949d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.349567:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009eb17432/0x5e4fb0a8aa19949d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.349575:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81be00 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:0.0:1782756256.349579:0:6603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb17432/0x5e4fb0a8aa19949d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.349589:0:6603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb17432/0x5e4fb0a8aa19949d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.349604:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009eb17432/0x5e4fb0a8aa19949d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.349611:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009eb17432/0x5e4fb0a8aa19949d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756256.350036:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79df9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+6:2356:x1869355210039168:12345-192.168.204.25@tcp:1:lhsmtool_posix.0 Request processed in 6107us (6246us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756256.350046:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 46 00000100:00100000:2.0:1782756256.361529:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756256.361628:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210039552 00000100:00100000:0.0:1782756256.361638:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210039552 00000100:00100000:0.0:1782756256.361714:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 127 00000100:00100000:0.0:1782756256.361742:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+14:10520:x1869355210039552:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1782756256.361824:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1994a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.361856:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1994a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.361869:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1994a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.362116:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1994ab lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.362129:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19945e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce03f expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.362140:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1994ab lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.362343:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19945e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce03f expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.362357:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19945e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce03f expref: 15 pid: 5805 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756256.362372:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c79dfb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1869355222627200:192.168.204.25@tcp:104: 00000100:00100000:2.0:1782756256.362460:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76d85e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782756256.368502:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756256.368672:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c79dfb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1869355222627200:192.168.204.25@tcp:104: 00010000:00010000:2.0:1782756256.368701:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1994ab lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756256.368875:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210039680 00000100:00100000:0.0:1782756256.368882:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210039680 00010000:00010000:0.0:1782756256.368925:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19945e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce03f expref: 16 pid: 5805 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756256.368967:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 59 00000100:00100000:0.0:1782756256.368976:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26487635-60cb-4aee-af8e-396654f6c3d8+16:2355:x1869355210039680:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782756256.369067:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756256.369277:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19945e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce03f expref: 16 pid: 5805 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.369303:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19945e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce03f expref: 16 pid: 5805 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.369324:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19945e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce03f expref: 16 pid: 5805 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.369341:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d3c4ef38e00) 00010000:00010000:0.0:1782756256.369346:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1994ab lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.369354:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1994ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756256.369361:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1994ab lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.371693:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782756256.371795:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26487635-60cb-4aee-af8e-396654f6c3d8+15:2355:x1869355210039680:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2813us (3295us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756256.371807:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 59 00010000:00010000:2.0:1782756256.373767:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1994ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.373786:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1994ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782756256.374126:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1782756256.374323:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1782756256.374370:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1782756256.374479:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c79dfb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5804:1869355222627328:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782756256.374547:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756256.374650:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76d85c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782756256.374738:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222627328 00000100:00100000:3.0:1782756256.374746:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222627328 00000100:00100000:3.0:1782756256.374835:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782756256.374846:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5804:x1869355222627328:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782756256.374936:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5804:x1869355222627328:12345-0@lo:1000:mdt00_001.0 Request processed in 92us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756256.374944:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782756256.375016:0:5804:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1782756256.375023:0:5804:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:2.0:1782756256.375044:0:5804:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d3c78f84a80, transno 4294967309 00000100:00100000:2.0:1782756256.375095:0:5804:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9d3c78f87b80 x1869355222626432/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1782756272 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782756256.375109:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c79dfb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5804:1869355222627328:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1782756256.375772:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1782756256.375828:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c79dfb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5804:1869355222627456:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782756256.375864:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756256.375995:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c46950180 going to sleep for 11 seconds 00000100:00100000:0.0:1782756256.376023:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222627456 00000100:00100000:0.0:1782756256.376029:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222627456 00000100:00100000:0.0:1782756256.376053:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782756256.376059:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79df8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5804:x1869355222627456:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782756256.380007:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79df8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5804:x1869355222627456:12345-0@lo:1000:mdt00_001.0 Request processed in 3937us (4132us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1782756256.380023:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782756256.380257:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c79dfb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5804:1869355222627456:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1782756256.380308:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1994ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.380319:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1994ab lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.380326:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1994ab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.380332:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81aa00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756256.380336:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1994ab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.380344:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1994ab lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.380376:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d3c4ef38e00) 00010000:00010000:1.0:1782756256.380379:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782756256.380384:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1994ab lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.380390:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1994ab lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.380432:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1993ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.380438:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1993ee lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.380443:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1993ee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.380448:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756256.380450:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1993ee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.380456:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1993ee lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.380463:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:1.0:1782756256.380465:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782756256.380471:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa1993f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce023 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.380482:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa1993f5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce023 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.380497:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa1993f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce023 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.380548:0:5804:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa1993f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce023 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756256.380563:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fae1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1869355222627584:192.168.204.25@tcp:105: 00000100:00100000:1.0:1782756256.380669:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78ef9240 going to sleep for 11 seconds 00000100:00100000:1.0:1782756256.386630:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fae1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1869355222627584:192.168.204.25@tcp:105: 00010000:00010000:1.0:1782756256.386666:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1993ee lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.386679:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1993ee lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.386719:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1994b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.386733:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1994b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.386745:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1994b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.386756:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1994b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.386763:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1994b2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.386783:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1994b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.386789:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756256.386793:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1994b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.386801:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1994b2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.386813:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:1.0:1782756256.386816:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756256.386820:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1994b2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.386827:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1994b2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.386837:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1994a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.386843:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1994a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.386849:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1994a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.386855:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81be00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756256.386857:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1994a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.386875:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1994a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.386884:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:1.0:1782756256.386886:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782756256.386890:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1994a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.386896:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1994a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756256.387162:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+18:10520:x1869355210039552:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 Request processed in 25422us (25640us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1782756256.387172:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 127 00000020:00080000:1.0:1782756256.387179:0:5804:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1782756256.387356:0:11537:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782756256.387362:0:11537:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1782756256.387601:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000040:00080000:0.0:1782756256.387905:0:11537:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1782756256.387913:0:11537:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782756256.388212:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210039808 00000100:00100000:2.0:1782756256.388220:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210039808 00000100:00100000:2.0:1782756256.388271:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 31 00000100:00100000:2.0:1782756256.388282:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+18:10519:x1869355210039808:12345-192.168.204.25@tcp:49:lfs.0 00000100:00100000:2.0:1782756256.388398:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+18:10519:x1869355210039808:12345-192.168.204.25@tcp:49:lfs.0 Request processed in 118us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756256.388427:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 31 00000100:00100000:3.0:1782756256.391599:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756256.394137:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210040064 00000100:00100000:1.0:1782756256.394152:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210040064 00000100:00100000:1.0:1782756256.394229:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 128 00000100:00100000:1.0:1782756256.394239:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+18:10519:x1869355210040064:12345-192.168.204.25@tcp:58:lfs.0 00000040:00080000:1.0:1782756256.394643:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1782756256.394736:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+18:10519:x1869355210040064:12345-192.168.204.25@tcp:58:lfs.0 Request processed in 497us (3143us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756256.394744:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 128 00000100:00100000:1.0:1782756256.395744:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756256.395910:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210040320 00000100:00100000:3.0:1782756256.395917:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210040320 00000100:00100000:3.0:1782756256.395966:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 32 00000100:00100000:3.0:1782756256.395975:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4977b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+18:10520:x1869355210040320:12345-192.168.204.25@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1782756256.396581:0:5807:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1782756256.396690:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1782756256.396742:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1994b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756256.396758:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1994b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756256.396770:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1994b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756256.396779:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1994b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756256.396786:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1994b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756256.396792:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1994b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756256.396821:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782756256.396852:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782756256.396860:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1994b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.396881:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168d600 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:1.0:1782756256.396885:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1994b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.396894:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1994b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756256.396904:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4977b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+20:10520:x1869355210040320:12345-192.168.204.25@tcp:35:lhsmtool_posix.0 Request processed in 928us (1162us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1782756256.396914:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 32 00000020:00080000:3.0:1782756256.396919:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782756256.396968:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d3c49e15600) 00010000:00010000:1.0:1782756256.396971:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782756256.396976:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1994b9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.397099:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa1994b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.397120:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756256.397122:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756256.397123:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756256.425521:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756256.428324:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210040448 00000100:00100000:2.0:1782756256.428340:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210040448 00000100:00100000:2.0:1782756256.428469:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 129 00000100:00100000:2.0:1782756256.428481:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+20:10522:x1869355210040448:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1782756256.428520:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756256.428543:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa1994c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce05b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.428615:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1994c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.428629:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1994c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.428641:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1994c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.428655:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa1994ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.428663:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa1994ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.428683:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa1994ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.428988:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa1994d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.429022:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1993e0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce01c expref: 21 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.429031:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa1994d5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.429067:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1993e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce01c expref: 21 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.430250:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1993e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce01c expref: 21 pid: 5803 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756256.430268:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7720b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1869355222627712:192.168.204.25@tcp:104: 00000100:00100000:2.0:1782756256.432898:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76d85240 going to sleep for 11 seconds 00000100:00100000:2.0:1782756256.435366:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7720b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1869355222627712:192.168.204.25@tcp:104: 00010000:00010000:2.0:1782756256.435396:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa1994d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756256.435801:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756256.436157:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210040704 00000100:00100000:3.0:1782756256.436165:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210040704 00000100:00100000:3.0:1782756256.436221:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 33 00000100:00100000:3.0:1782756256.436231:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+22:5578:x1869355210040704:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1782756256.436575:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+23:5578:x1869355210040704:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 345us (774us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1782756256.436596:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 33 00000100:00100000:0.0:1782756256.438768:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756256.438864:0:8367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210040832 00000100:00100000:1.0:1782756256.438872:0:8367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210040832 00010000:00010000:1.0:1782756256.438905:0:8367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1993e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce01c expref: 23 pid: 5803 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756256.439121:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 60 00000100:00100000:2.0:1782756256.439135:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c501d5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+23:2356:x1869355210040832:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782756256.439152:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756256.439161:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1993e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce01c expref: 23 pid: 5803 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.439176:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1993e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce01c expref: 23 pid: 5803 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.439226:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1993e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce01c expref: 23 pid: 5803 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.439242:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:2.0:1782756256.439248:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa1994d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.439257:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa1994d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.439264:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa1994d5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756256.439305:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756256.439359:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c501d5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+22:2356:x1869355210040832:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 227us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756256.439376:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 60 00010000:00010000:1.0:1782756256.439447:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa1994d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.439456:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa1994d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756256.439508:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1782756256.439513:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782756256.439530:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa1994d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.439543:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa1994d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.439553:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1994c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.439559:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1994c7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.439566:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1994c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.439571:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756256.439575:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1994c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.439582:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1994c7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.439592:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:1.0:1782756256.439594:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756256.439598:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1994c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.439604:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1994c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.439628:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa1994ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.439635:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa1994ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.439642:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa1994ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.439647:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756256.439651:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa1994ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.439657:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa1994ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.439665:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d3c58212000) 00010000:00010000:1.0:1782756256.439667:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756256.439671:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa1994ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.439677:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa1994ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.439711:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa1994c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce05b expref: 22 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.439726:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa1994d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce05b expref: 21 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756256.439745:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:1.0:1782756256.439747:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782756256.439750:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63c800, rc 0) 00000100:00100000:1.0:1782756256.439777:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+21:10522:x1869355210040448:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 11299us (14267us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756256.439784:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 129 00000100:00100000:0.0:1782756256.716388:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78f8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222627840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782756256.716475:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756256.716619:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222627840 00000100:00100000:3.0:1782756256.716629:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222627840 00000100:00100000:3.0:1782756256.716684:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782756256.716695:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1869355222627840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782756256.716719:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1782756256.716785:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1869355222627840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756256.716792:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782756256.716922:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78f8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222627840:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1782756257.047953:0:11957:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782756257.047962:0:11957:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782756257.048008:0:11957:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1782756257.048014:0:11957:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1782756257.228526:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782756257.421048:0:11537:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782756257.421057:0:11537:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782756257.421210:0:11537:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1782756257.421218:0:11537:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782756257.421351:0:11537:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76f8ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11537:1869355222627968:192.168.204.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782756257.421492:0:11537:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76d17d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782756257.425797:0:11537:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76f8ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11537:1869355222627968:192.168.204.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782756257.429315:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756257.429386:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210040960 00000100:00100000:2.0:1782756257.429405:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210040960 00000100:00080000:3.0:1782756257.429452:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782756257.429507:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 130 00000100:00100000:2.0:1782756257.429517:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+21:10534:x1869355210040960:12345-192.168.204.25@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782756257.429547:0:5805:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782756257.429632:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+21:10534:x1869355210040960:12345-192.168.204.25@tcp:53:lhsmtool_posix.0 Request processed in 117us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756257.429650:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 130 00000100:00100000:0.0:1782756257.437462:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756257.437591:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210041216 00000100:00100000:1.0:1782756257.437601:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210041216 00000100:00100000:1.0:1782756257.437660:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 131 00000100:00100000:1.0:1782756257.437670:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+21:10534:x1869355210041216:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782756257.437693:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756257.437717:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1994dc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce062 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756257.437840:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1994e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756257.437855:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1994e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756257.437867:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1994e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756257.437897:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1782756257.438260:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1994dc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce062 expref: 24 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756257.438281:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1994e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce062 expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756257.438289:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:1.0:1782756257.438292:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782756257.438295:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef5c00, rc 0) 00000100:00100000:1.0:1782756257.438363:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+23:10534:x1869355210041216:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 695us (911us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1782756257.438371:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 131 00000100:00100000:3.0:1782756257.441587:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756257.441694:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210041344 00000100:00100000:2.0:1782756257.441703:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210041344 00000100:00100000:2.0:1782756257.441801:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9 00000100:00100000:2.0:1782756257.441811:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+23:2358:x1869355210041344:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782756257.441826:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756257.441850:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1994e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce062 expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756257.441873:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:2.0:1782756257.441878:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756257.441941:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+22:2358:x1869355210041344:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 132us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756257.441948:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9 00000100:00100000:0.0:1782756257.446663:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756257.446861:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210041600 00000100:00100000:1.0:1782756257.446871:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210041600 00000100:00100000:1.0:1782756257.446965:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 132 00000100:00100000:1.0:1782756257.446976:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+22:10534:x1869355210041600:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1782756257.447072:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1994f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756257.447216:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1994f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756257.447229:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1994f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756257.447670:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1994f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756257.447687:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1994f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756257.447694:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1994f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756257.447701:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5a00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756257.447706:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1994f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756257.447714:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1994f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756257.447726:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:1.0:1782756257.447729:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782756257.447733:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1994f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756257.447740:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1994f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756257.448069:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+23:10534:x1869355210041600:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 Request processed in 1019us (1367us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1782756257.448107:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 132 00000040:00080000:0.0:1782756257.449188:0:11537:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782756257.449193:0:11537:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782756257.449615:0:11537:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1782756257.449624:0:11537:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782756257.454980:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756257.457825:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210041856 00000100:00100000:2.0:1782756257.457843:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210041856 00000100:00100000:2.0:1782756257.457922:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 34 00000100:00100000:2.0:1782756257.457933:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+23:10534:x1869355210041856:12345-192.168.204.25@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1782756257.458216:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+24:10534:x1869355210041856:12345-192.168.204.25@tcp:35:lhsmtool_posix.0 Request processed in 284us (3318us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1782756257.458224:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 34 00000100:00100000:3.0:1782756258.089978:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756258.090069:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756258.090149:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756258.090199:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756258.090213:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210042496 00000100:00100000:2.0:1782756258.090224:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210042496 00000100:00100000:3.0:1782756258.090233:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756258.090260:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210042112 00000100:00100000:3.0:1782756258.090264:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210042112 00000100:00100000:2.0:1782756258.090299:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 108 00000100:00100000:2.0:1782756258.090310:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2358:x1869355210042496:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756258.090353:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210042240 00000100:00100000:0.0:1782756258.090357:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210042240 00000100:00100000:0.0:1782756258.090396:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210042368 00000100:00100000:0.0:1782756258.090399:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210042368 00000100:00100000:2.0:1782756258.090410:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2358:x1869355210042496:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 104us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756258.090420:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 57 00000100:00100000:0.0:1782756258.090429:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+6:2358:x1869355210042240:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756258.090459:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+6:2358:x1869355210042240:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 33us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756258.090465:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 57 00000100:00100000:0.0:1782756258.090479:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 58 00000100:00100000:0.0:1782756258.090485:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+5:2358:x1869355210042368:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756258.090516:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+5:2358:x1869355210042368:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 31us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756258.090522:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 58 00000100:00100000:1.0:1782756258.091851:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210041984 00000100:00100000:1.0:1782756258.091861:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210041984 00000100:00100000:3.0:1782756258.091886:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 109 00000100:00100000:1.0:1782756258.091909:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 276 00000100:00100000:1.0:1782756258.091916:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2358:x1869355210041984:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:2.0:1782756258.091921:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 108 00000100:00080000:2.0:1782756258.091974:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782756258.091978:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782756258.091981:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782756258.092041:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+24:2358:x1869355210042112:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1782756258.092112:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2358:x1869355210041984:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 196us (2144us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756258.092131:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 276 00000100:00100000:3.0:1782756258.092389:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+24:2358:x1869355210042112:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 344us (2180us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756258.092398:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 109 00010000:00010000:3.0:1782756258.252487:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782756258.252595:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222628096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782756258.252672:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756258.252718:0:8071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222628096 00000100:00100000:1.0:1782756258.252726:0:8071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222628096 00000100:00100000:2.0:1782756258.252743:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222628608:0@lo:400:kworker.0 00000100:00100000:0.0:1782756258.252746:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0daec403-69b6-4c98-a0ea-f519ca0a480f:3315:1869355222628224:0@lo:400:kworker.0 00000100:00100000:2.0:1782756258.252781:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756258.252799:0:8071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782756258.252805:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756258.252814:0:8071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7720b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1869355222628096:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782756258.252827:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869355222628480:0@lo:400:kworker.0 00000100:00100000:3.0:1782756258.252839:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869355222628352:0@lo:400:kworker.0 00000100:00100000:0.0:1782756258.252848:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869355222628736:0@lo:400:kworker.0 00002000:00000024:1.0:1782756258.252850:0:8071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782756258.252864:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756258.252894:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756258.252918:0:8071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7720b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1869355222628096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756258.252928:0:8071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782756258.252949:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782756258.252975:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782756258.253000:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222628096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782756258.253002:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222628480 00000100:00100000:3.0:1782756258.253007:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222628224 00000100:00100000:2.0:1782756258.253009:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222628480 00000100:00100000:3.0:1782756258.253015:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222628224 00000100:00100000:0.0:1782756258.253018:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222628352 00000100:00100000:0.0:1782756258.253024:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222628352 00000100:00100000:2.0:1782756258.253054:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222628736 00000100:00100000:2.0:1782756258.253058:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222628736 00000100:00100000:0.0:1782756258.253063:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1782756258.253068:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1782756258.253104:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3315:x1869355222628224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756258.253112:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869355222628480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756258.253113:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1782756258.253124:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869355222628352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756258.253135:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1782756258.253144:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1782756258.253170:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3315:x1869355222628224:12345-0@lo:400:kworker.0 Request processed in 92us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756258.253177:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869355222628480:12345-0@lo:400:kworker.0 Request processed in 104us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756258.253187:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1782756258.253188:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0daec403-69b6-4c98-a0ea-f519ca0a480f:3315:1869355222628224:0@lo:400:kworker.0 00000100:00100000:3.0:1782756258.253193:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1782756258.253218:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1782756258.253227:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869355222628736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782756258.253235:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222628608 00000100:00100000:3.0:1782756258.253241:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222628608 00000100:00100000:0.0:1782756258.253273:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869355222628736:12345-0@lo:400:kworker.0 Request processed in 46us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756258.253278:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782756258.253286:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1782756258.253289:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869355222628352:12345-0@lo:400:kworker.0 Request processed in 165us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756258.253292:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7720b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1869355222628608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756258.253302:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1782756258.253311:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869355222628736:0@lo:400:kworker.0 00000100:00080000:2.0:1782756258.253343:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782756258.253348:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782756258.253350:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7720b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1869355222628608:12345-0@lo:400:kworker.0 Request processed in 61us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756258.253359:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782756258.253373:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869355222628352:0@lo:400:kworker.0 00000100:00100000:0.0:1782756258.253398:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222628608:0@lo:400:kworker.0 00000100:00100000:2.0:1782756258.253421:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869355222628480:0@lo:400:kworker.0 00000040:00080000:0.0:1782756258.661824:0:12009:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782756258.661833:0:12009:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782756258.661877:0:12009:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1782756258.661883:0:12009:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782756258.814070:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756258.814259:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210042752 00000100:00100000:0.0:1782756258.814276:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210042752 00000100:00100000:0.0:1782756258.814401:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 133 00000100:00100000:0.0:1782756258.814413:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+24:10554:x1869355210042752:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1782756258.814435:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756258.814458:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa1994f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce069 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756258.814559:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b800/0x5e4fb0a8aa1994ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756258.814573:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b800/0x5e4fb0a8aa1994ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756258.814590:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b800/0x5e4fb0a8aa1994ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782756258.814602:0:6579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1782756258.814724:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa1994f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce069 expref: 27 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756258.814741:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b800/0x5e4fb0a8aa1994ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce069 expref: 26 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756258.814749:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:0.0:1782756258.814752:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1782756258.814755:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81b800, rc 0) 00000100:00100000:0.0:1782756258.814823:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+26:10554:x1869355210042752:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 413us (763us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1782756258.814830:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 133 00000100:00100000:2.0:1782756258.818332:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756258.818413:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210042880 00000100:00100000:0.0:1782756258.818426:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210042880 00000100:00100000:0.0:1782756258.818666:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 134 00000100:00100000:0.0:1782756258.818678:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+26:10554:x1869355210042880:12345-192.168.204.25@tcp:54:lfs.0 00010000:00010000:0.0:1782756258.818745:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa19950d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756258.818761:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa19950d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756258.818773:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa19950d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756258.818800:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa19950d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756258.818807:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa19950d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756258.818812:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa19950d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756258.818817:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81b000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756258.818821:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa19950d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756258.818827:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa19950d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756258.818837:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:0.0:1782756258.818840:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782756258.818844:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa19950d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756258.818863:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa19950d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756258.818947:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+26:10554:x1869355210042880:12345-192.168.204.25@tcp:54:lfs.0 Request processed in 271us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756258.818956:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 134 00000100:00100000:1.0:1782756258.944634:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756258.944847:0:10416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210043008 00000100:00100000:2.0:1782756258.944861:0:10416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210043008 00000100:00100000:2.0:1782756258.944943:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 47 00000100:00100000:2.0:1782756258.944955:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+6:2356:x1869355210043008:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1782756258.944980:0:10416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756258.945017:0:10416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9209775/0x5e4fb0a8aa199514 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce070 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782756258.945062:0:10416:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a42b39e, atime: 0x6a42b39e, ctime: 0x6a42b39e, blocks: 0xb 00010000:00010000:2.0:1782756258.945136:0:10416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=300s v=(0 0) 00010000:00010000:2.0:1782756258.945142:0:10416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756258.945155:0:10416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9209775/0x5e4fb0a8aa199514 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce070 expref: 7 pid: 10416 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756258.945192:0:10416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a9209775/0x5e4fb0a8aa199514 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce070 expref: 7 pid: 10416 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756258.945210:0:10416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63d800, rc 0) 00000100:00100000:2.0:1782756258.945291:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+7:2356:x1869355210043008:12345-192.168.204.25@tcp:101:cat.0 Request processed in 338us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756258.945299:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 47 00000100:00100000:3.0:1782756258.950174:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756258.950331:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210043136 00000100:00100000:1.0:1782756258.950343:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210043136 00002000:00100000:1.0:1782756258.950430:0:6609:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9d3c78f8e300 x1869355210043136/t0(0) o3->26487635-60cb-4aee-af8e-396654f6c3d8@192.168.204.25@tcp:439/0 lens 488/0 e 0 to 0 dl 1782756269 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782756258.950440:0:6609:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3c78f8e300 with x1869355210043136 ext(0->4095) 00002000:00010000:1.0:1782756258.950447:0:6609:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d3c78f8e300 00000100:00100000:1.0:1782756258.950548:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 4 00000100:00100000:1.0:1782756258.950557:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26487635-60cb-4aee-af8e-396654f6c3d8+7:2357:x1869355210043136:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1782756258.951308:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26487635-60cb-4aee-af8e-396654f6c3d8+7:2357:x1869355210043136:12345-192.168.204.25@tcp:3:cat.0 Request processed in 745us (1140us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1782756258.951327:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 4 00002000:00100000:1.0:1782756258.951337:0:6609:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9d3c78f8e300 x1869355210043136/t0(0) o3->26487635-60cb-4aee-af8e-396654f6c3d8@192.168.204.25@tcp:439/0 lens 488/4536 e 0 to 0 dl 1782756269 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782756258.951347:0:6609:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3c78f8e300 with x1869355210043136 ext(0->4095) 00002000:00010000:1.0:1782756258.951353:0:6609:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d3c78f8e300 00010000:00010000:1.0:1782756259.277041:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756260.300469:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782756260.343756:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:2.0:1782756261.326258:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782756261.359581:0:6627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1782756261.359603:0:6627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1782756261.370018:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1782756261.370061:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d3c76d85c00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1782756261.370066:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d3c4aa72000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d3c76d85d80 00000020:00080000:3.0:1782756261.370070:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d3c4aa72a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d3c76f86c00 00000020:00080000:2.0:1782756261.370191:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000020:00080000:2.0:1782756261.370390:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1782756261.370481:0:5825:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000100:00100000:2.0:1782756261.836561:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c770fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222628864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782756261.836649:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756261.836780:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222628864 00000100:00100000:1.0:1782756261.836789:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222628864 00000100:00100000:1.0:1782756261.836911:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782756261.836921:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222628864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782756261.836959:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782756261.837010:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222628864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756261.837018:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782756261.837053:0:3316:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1782756261.837057:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d3c78f87b80, transno 4294967310 00000004:00080000:1.0:1782756261.837068:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1782756261.837104:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c770fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222628864:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782756261.837231:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782756262.348750:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756262.736448:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756262.736746:0:11978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210043264 00000100:00100000:3.0:1782756262.736758:0:11978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210043264 00000100:00100000:3.0:1782756262.736840:0:11978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 135 00000100:00100000:3.0:1782756262.736850:0:11978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+13:10199:x1869355210043264:12345-192.168.204.25@tcp:60:lhsmtool_posix.0 00000100:00080000:2.0:1782756262.737066:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782756262.737307:0:11978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+13:10199:x1869355210043264:12345-192.168.204.25@tcp:60:lhsmtool_posix.0 Request processed in 457us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756262.737316:0:11978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 135 00000100:00100000:0.0:1782756262.749944:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756262.750021:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210043520 00000100:00100000:2.0:1782756262.750033:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210043520 00000100:00100000:2.0:1782756262.750122:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 35 00000100:00100000:2.0:1782756262.750133:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+13:10199:x1869355210043520:12345-192.168.204.25@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1782756262.750731:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+14:10199:x1869355210043520:12345-192.168.204.25@tcp:35:lhsmtool_posix.0 Request processed in 589us (784us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1782756262.750741:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 35 00000100:00100000:1.0:1782756263.070556:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756263.070668:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210043648 00000100:00100000:0.0:1782756263.070679:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210043648 00000100:00100000:0.0:1782756263.070819:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 136 00000100:00100000:0.0:1782756263.070833:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:11006:x1869355210043648:12345-192.168.204.25@tcp:101:lsof.0 00010000:00010000:0.0:1782756263.070853:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756263.070875:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19951b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce077 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756263.070940:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa199522 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756263.070955:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa199522 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756263.070967:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa199522 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782756263.071382:0:6579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782756263.071387:0:6579:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1782756263.071506:0:6579:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa199522 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756263.071536:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19951b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce077 expref: 7 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756263.071554:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa199522 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce077 expref: 6 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756263.071563:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c4ef38400) 00010000:00010000:0.0:1782756263.071566:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782756263.071570:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81be00, rc 0) 00000100:00100000:0.0:1782756263.071687:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+6:11006:x1869355210043648:12345-192.168.204.25@tcp:101:lsof.0 Request processed in 858us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756263.071695:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 136 00000100:00080000:2.0:1782756263.073761:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782756263.211646:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756263.211704:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756263.211735:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756263.211995:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210043904 00000100:00100000:3.0:1782756263.212005:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210043904 00000100:00100000:3.0:1782756263.212097:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210044032 00000100:00100000:3.0:1782756263.212101:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210044032 00000100:00100000:3.0:1782756263.212124:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 60 00000100:00100000:3.0:1782756263.212133:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+6:2357:x1869355210043904:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756263.212202:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+6:2357:x1869355210043904:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 70us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756263.212210:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 60 00000100:00100000:3.0:1782756263.212228:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 61 00000100:00100000:3.0:1782756263.212234:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+5:2357:x1869355210044032:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756263.212259:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+5:2357:x1869355210044032:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 26us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756263.212266:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 61 00000100:00100000:1.0:1782756263.212617:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210043776 00000100:00100000:1.0:1782756263.212623:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210043776 00000100:00100000:1.0:1782756263.212665:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 278 00000100:00100000:1.0:1782756263.212673:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aaff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2357:x1869355210043776:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1782756263.212716:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aaff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2357:x1869355210043776:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 44us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756263.212723:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 278 00000100:00080000:0.0:1782756263.212958:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782756263.212963:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782756263.372364:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869355222629120:0@lo:400:kworker.0 00000100:00100000:3.0:1782756263.372500:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756263.372572:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222629632:0@lo:400:kworker.0 00000100:00100000:3.0:1782756263.372604:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756263.372629:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782756263.372635:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222629248:0@lo:400:kworker.0 00000100:00100000:3.0:1782756263.372657:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756263.372700:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222629632 00000100:00100000:3.0:1782756263.372707:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222629632 00010000:00010000:1.0:1782756263.373017:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756263.373031:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78edb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222629376:0@lo:400:kworker.0 00000100:00100000:3.0:1782756263.373065:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782756263.373067:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756263.373095:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222629632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756263.373117:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782756263.373126:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c79dfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222628992:0@lo:400:kworker.0 00000100:00100000:3.0:1782756263.373157:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222629632:12345-0@lo:400:kworker.0 Request processed in 80us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756263.373166:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782756263.373168:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756263.373197:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78ed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869355222629504:0@lo:400:kworker.0 00000100:00100000:3.0:1782756263.373200:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222629376 00000100:00100000:3.0:1782756263.373205:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222629376 00000100:00100000:1.0:1782756263.373226:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756263.373236:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782756263.373246:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222629376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782756263.373299:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222629376:12345-0@lo:400:kworker.0 Request processed in 55us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756263.373306:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222629760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782756263.373308:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782756263.373334:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222628992 00000100:00100000:3.0:1782756263.373339:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222628992 00000100:00100000:1.0:1782756263.373342:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756263.373376:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222629760 00000100:00100000:1.0:1782756263.373388:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222629760 00000100:00100000:3.0:1782756263.373394:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1782756263.373404:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3316:x1869355222628992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756263.373423:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1782756263.373434:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fae3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222629760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782756263.373462:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782756263.373552:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3316:x1869355222628992:12345-0@lo:400:kworker.0 Request processed in 150us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756263.373558:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00080000:3.0:1782756263.373587:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782756263.373591:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782756263.373659:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222629120 00000100:00100000:0.0:1782756263.373665:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222629120 00000100:00100000:0.0:1782756263.373693:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222629248 00000100:00100000:0.0:1782756263.373696:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222629248 00000100:00100000:0.0:1782756263.373725:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222629504 00000100:00100000:0.0:1782756263.373728:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222629504 00000100:00100000:0.0:1782756263.373746:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1782756263.373753:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869355222629120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756263.373794:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869355222629120:12345-0@lo:400:kworker.0 Request processed in 42us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756263.373809:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1782756263.373823:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1782756263.373830:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222629248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756263.373861:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222629248:12345-0@lo:400:kworker.0 Request processed in 32us (1203us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756263.373867:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1782756263.373880:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1782756263.373887:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869355222629504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756263.373914:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869355222629504:12345-0@lo:400:kworker.0 Request processed in 28us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756263.373920:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1782756263.373984:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c79dfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222628992:0@lo:400:kworker.0 00000100:00100000:0.0:1782756263.373999:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869355222629504:0@lo:400:kworker.0 00000100:00100000:0.0:1782756263.374009:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78edb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222629376:0@lo:400:kworker.0 00000100:00100000:2.0:1782756263.374160:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222629248:0@lo:400:kworker.0 00000100:00100000:2.0:1782756263.374170:0:3314:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1782756263.374175:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d3c76f8ce00, transno 4294967304 00000100:00100000:2.0:1782756263.374190:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222629632:0@lo:400:kworker.0 00000100:00100000:2.0:1782756263.374202:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869355222629120:0@lo:400:kworker.0 00000100:00100000:1.0:1782756263.375024:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fae3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222629760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1589us (1678us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756263.375034:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782756263.375185:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222629760:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1782756263.378123:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782756264.396562:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782756264.652543:0:11537:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782756264.652553:0:11537:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782756264.652831:0:11537:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1782756264.652837:0:11537:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1782756265.423763:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782756266.066856:0:12210:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 14:04:24 (1782756264) 00010000:00010000:0.0:1782756266.444313:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782756266.513530:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1782756266.513547:0:5825:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1782756266.513610:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1782756266.513631:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1782756266.956382:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c770fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222629888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782756266.956456:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756266.956508:0:8071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222629888 00000100:00100000:2.0:1782756266.956517:0:8071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222629888 00000100:00080000:3.0:1782756266.956551:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782756266.956575:0:8071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782756266.956586:0:8071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222629888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782756266.956620:0:8071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782756266.958235:0:8071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222629888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1643us (1772us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756266.958264:0:8071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782756266.959321:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c770fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222629888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782756267.281551:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756267.281650:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210044288 00000100:00100000:2.0:1782756267.281659:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210044288 00000100:00100000:2.0:1782756267.281759:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 137 00000100:00100000:2.0:1782756267.281770:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+13:11272:x1869355210044288:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782756267.281793:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756267.281813:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa199529 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce07e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782756267.281874:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782756267.281885:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa199530 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756267.281899:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa199530 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756267.281913:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa199530 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756267.281927:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa199537 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756267.281935:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa199537 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756267.281942:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa199537 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756267.282451:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19953e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756267.282471:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19953e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756267.282478:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19953e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756267.282488:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1782756267.282689:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa199530 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756267.282697:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa199530 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756267.282705:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa199530 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756267.282710:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756267.282715:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa199530 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756267.282723:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa199530 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756267.282735:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d3c58212100) 00010000:00010000:2.0:1782756267.282738:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756267.282743:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa199530 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756267.282749:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa199530 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756267.282763:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa199537 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756267.282775:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa199537 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756267.282780:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa199537 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756267.282785:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63dc00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756267.282788:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa199537 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756267.282794:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa199537 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756267.282802:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9d3c58212800) 00010000:00010000:2.0:1782756267.282804:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756267.282807:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa199537 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756267.282812:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa199537 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756267.283240:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa199529 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce07e expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756267.283257:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19953e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce07e expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756267.283265:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3c54288100) 00010000:00010000:2.0:1782756267.283267:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756267.283275:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63de00, rc 0) 00000100:00100000:2.0:1782756267.283347:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+15:11272:x1869355210044288:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 1578us (1804us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1782756267.283355:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 137 00000100:00100000:1.0:1782756267.287686:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756267.287775:0:11978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210044416 00000100:00100000:0.0:1782756267.287785:0:11978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210044416 00000100:00100000:0.0:1782756267.287914:0:11978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 138 00000100:00100000:0.0:1782756267.287924:0:11978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+15:11272:x1869355210044416:12345-192.168.204.25@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1782756267.288042:0:11978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+15:11272:x1869355210044416:12345-192.168.204.25@tcp:59:lhsmtool_posix.0 Request processed in 120us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756267.288049:0:11978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 138 00000100:00100000:1.0:1782756267.289908:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756267.290139:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210044544 00000100:00100000:2.0:1782756267.290146:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210044544 00000100:00100000:2.0:1782756267.290240:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 10 00000100:00100000:2.0:1782756267.290250:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+15:2358:x1869355210044544:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782756267.290264:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756267.290289:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19953e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce07e expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756267.290308:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3c54288100) 00010000:00010000:2.0:1782756267.290312:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756267.290366:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+14:2358:x1869355210044544:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 117us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756267.290373:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 10 00010000:00010000:1.0:1782756267.472881:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782756267.731482:0:11537:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782756267.731497:0:11537:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782756267.731545:0:11537:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1782756267.731554:0:11537:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782756268.330465:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756268.330505:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756268.330525:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756268.330545:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756268.330572:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210044672 00000100:00100000:3.0:1782756268.330583:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756268.330591:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210044672 00000100:00100000:3.0:1782756268.330613:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210044928 00000100:00100000:3.0:1782756268.330621:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210044928 00000100:00100000:1.0:1782756268.330684:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 280 00000100:00100000:3.0:1782756268.330687:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210045056 00000100:00100000:3.0:1782756268.330691:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210045056 00000100:00100000:1.0:1782756268.330702:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2355:x1869355210044672:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756268.330724:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 64 00000100:00100000:3.0:1782756268.330741:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+6:2355:x1869355210044928:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:2.0:1782756268.330761:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 65 00000100:00100000:2.0:1782756268.330779:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+5:2355:x1869355210045056:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756268.330823:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+6:2355:x1869355210044928:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 76us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756268.330824:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2355:x1869355210044672:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 120us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756268.330843:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+5:2355:x1869355210045056:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 59us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756268.330863:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 64 00000100:00100000:1.0:1782756268.330873:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 280 00000100:00100000:2.0:1782756268.330880:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 65 00000100:00100000:3.0:1782756268.330898:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210045184 00000100:00100000:3.0:1782756268.331465:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210045184 00000100:00100000:3.0:1782756268.331511:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210044800 00000100:00100000:3.0:1782756268.331514:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210044800 00000100:00100000:3.0:1782756268.331552:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 116 00000100:00100000:1.0:1782756268.331568:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 117 00000100:00100000:3.0:1782756268.331570:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+6:2355:x1869355210045184:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1782756268.331589:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+14:2355:x1869355210044800:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1782756268.331648:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+14:2355:x1869355210044800:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 58us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756268.331649:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+6:2355:x1869355210045184:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 76us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756268.331671:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 117 00000100:00100000:3.0:1782756268.331684:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 116 00000100:00080000:1.0:1782756268.331731:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782756268.331739:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782756268.331746:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782756268.492653:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c770fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222630016:0@lo:400:kworker.0 00000100:00100000:3.0:1782756268.492753:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756268.492809:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c770fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869355222630528:0@lo:400:kworker.0 00000100:00100000:3.0:1782756268.492840:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756268.492882:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782756268.492889:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c770ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222630400:0@lo:400:kworker.0 00000100:00100000:3.0:1782756268.492919:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756268.492952:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c770fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869355222630144:0@lo:400:kworker.0 00000100:00100000:3.0:1782756268.492980:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756268.493000:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c770ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222630656:0@lo:400:kworker.0 00000100:00100000:3.0:1782756268.493023:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756268.493044:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782756268.493049:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c770fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222630272:0@lo:400:kworker.0 00000100:00100000:3.0:1782756268.493096:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756268.493135:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222630016 00000100:00100000:1.0:1782756268.493720:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222630528 00000100:00100000:3.0:1782756268.493731:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222630016 00000100:00100000:1.0:1782756268.493733:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222630528 00000100:00100000:1.0:1782756268.493799:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222630144 00000100:00100000:3.0:1782756268.493800:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1782756268.493805:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222630144 00000100:00100000:3.0:1782756268.493815:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3317:x1869355222630016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756268.493827:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222630272 00000100:00100000:1.0:1782756268.493852:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222630272 00000100:00100000:1.0:1782756268.493884:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1782756268.493891:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3317:x1869355222630016:12345-0@lo:400:kworker.0 Request processed in 79us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756268.493901:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1782756268.493910:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869355222630528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782756268.493957:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1782756268.493965:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869355222630528:12345-0@lo:400:kworker.0 Request processed in 73us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756268.493968:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869355222630144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756268.493992:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1782756268.494010:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869355222630144:12345-0@lo:400:kworker.0 Request processed in 45us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756268.494014:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1782756268.494023:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1782756268.494028:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222630272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782756268.494065:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76d7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222630784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782756268.494071:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222630272:12345-0@lo:400:kworker.0 Request processed in 45us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756268.494127:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1782756268.494142:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756268.494152:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222630400 00000100:00100000:1.0:1782756268.494158:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222630400 00000100:00100000:3.0:1782756268.494198:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222630784 00000100:00100000:3.0:1782756268.494203:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222630784 00000100:00100000:1.0:1782756268.494206:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222630656 00000100:00100000:1.0:1782756268.494211:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222630656 00000100:00100000:3.0:1782756268.494251:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782756268.494258:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43617800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1869355222630784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782756268.494295:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782756268.494329:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43617800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1869355222630784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756268.494336:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782756268.494443:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782756268.494453:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222630400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756268.494492:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222630400:12345-0@lo:400:kworker.0 Request processed in 41us (1572us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756268.494499:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782756268.494511:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782756268.494518:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222630656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756268.494547:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222630656:12345-0@lo:400:kworker.0 Request processed in 30us (1523us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756268.494553:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782756268.498780:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76d7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222630784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782756268.499153:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c770fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222630272:0@lo:400:kworker.0 00000100:00100000:2.0:1782756268.499171:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c770fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869355222630144:0@lo:400:kworker.0 00000100:00100000:2.0:1782756268.499198:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c770ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222630656:0@lo:400:kworker.0 00000100:00100000:2.0:1782756268.499246:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c770ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222630400:0@lo:400:kworker.0 00000100:00100000:2.0:1782756268.499259:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c770fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222630016:0@lo:400:kworker.0 00000100:00100000:2.0:1782756268.499272:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c770fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869355222630528:0@lo:400:kworker.0 00010000:00010000:3.0:1782756268.499898:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782756268.500187:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782756268.500195:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782756268.500199:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782756269.143368:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756269.143448:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210045312 00000100:00100000:2.0:1782756269.143465:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210045312 00000100:00100000:2.0:1782756269.143575:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 139 00000100:00100000:2.0:1782756269.143588:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+14:11314:x1869355210045312:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1782756269.143609:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756269.143632:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19954c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce085 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.143726:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa199553 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.143742:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa199553 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.143755:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa199553 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.143769:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19955a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.143777:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19955a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.143783:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19955a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.144203:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa199553 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.144212:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa199553 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.144219:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa199553 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.144228:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d600 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756269.144233:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa199553 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.144241:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa199553 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.144258:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c4ef38400) 00010000:00010000:2.0:1782756269.144263:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756269.144267:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa199553 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.144274:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa199553 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.144290:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19955a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.144296:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19955a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.144302:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19955a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.144318:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63c000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756269.144323:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19955a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.144331:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19955a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.144341:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d3c58212d00) 00010000:00010000:2.0:1782756269.144343:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756269.144346:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19955a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.144353:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19955a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.144412:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19954c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce085 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.144430:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c4ef38400) 00010000:00010000:2.0:1782756269.144433:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756269.144437:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19954c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce085 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.144447:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63cc00, rc 0) 00000100:00100000:2.0:1782756269.144541:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+14:11314:x1869355210045312:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 954us (1186us total) trans 0 rc 301/301 00000100:00100000:2.0:1782756269.144552:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 139 00000100:00080000:3.0:1782756269.144881:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782756269.150368:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756269.150571:0:11978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210045568 00000100:00100000:0.0:1782756269.150585:0:11978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210045568 00000100:00100000:0.0:1782756269.150667:0:11978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 140 00000100:00100000:0.0:1782756269.150679:0:11978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+14:11314:x1869355210045568:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:0.0:1782756269.150778:0:11978:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756269.151620:0:11978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4a00/0x5e4fb0a8aa198eca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdebe expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.151646:0:11978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c4ef38400) 00010000:00010000:0.0:1782756269.151651:0:11978:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782756269.152227:0:11978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa199561 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.152247:0:11978:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa199522 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce077 expref: 5 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.152257:0:11978:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa199561 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.152311:0:11978:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa199522 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce077 expref: 5 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.152339:0:11978:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa199522 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce077 expref: 5 pid: 6579 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756269.152359:0:11978:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76f8ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11978:1869355222630912:192.168.204.25@tcp:104: 00000100:00100000:0.0:1782756269.152649:0:11978:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78ef9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782756269.155709:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756269.155743:0:11978:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76f8ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11978:1869355222630912:192.168.204.25@tcp:104: 00010000:00010000:2.0:1782756269.155786:0:11978:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa199561 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756269.155906:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210045696 00000100:00100000:3.0:1782756269.155915:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210045696 00010000:00010000:3.0:1782756269.156008:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa199522 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce077 expref: 6 pid: 6579 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756269.156054:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 61 00000100:00100000:3.0:1782756269.156064:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+6:2356:x1869355210045696:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782756269.156106:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756269.156114:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa199522 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce077 expref: 6 pid: 6579 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.156129:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa199522 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce077 expref: 6 pid: 6579 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.156157:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa199522 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce077 expref: 6 pid: 6579 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.156226:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c4ef38400) 00010000:00010000:3.0:1782756269.156232:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa199561 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.156243:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa199561 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.156251:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa199561 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.156315:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782756269.156385:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2356:x1869355210045696:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 321us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756269.156393:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 61 00010000:00010000:2.0:1782756269.156987:0:11978:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa199561 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.156997:0:11978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa199561 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.157025:0:11978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa199568 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.157035:0:11978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa199568 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.157044:0:11978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa199568 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756269.158754:0:11978:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1782756269.158774:0:11978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa199561 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.158784:0:11978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa199561 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.158791:0:11978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa199561 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.158797:0:11978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81a000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756269.158803:0:11978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa199561 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.158810:0:11978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa199561 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.158834:0:11978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c4ef38400) 00010000:00010000:2.0:1782756269.158837:0:11978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756269.158842:0:11978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa199561 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.158848:0:11978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa199561 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782756269.158869:0:11978:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000962c5672 reply state 0000000010b30b15 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa199568 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756269.158878:0:11978:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782756269.159051:0:11978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+15:11314:x1869355210045568:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 8370us (8695us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1782756269.159061:0:11978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 140 00010000:00010000:2.0:1782756269.160843:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa199568 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.160863:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa199568 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.160885:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa199568 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.160891:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63cc00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756269.160897:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa199568 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.160905:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa199568 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.160935:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d3c58212d00) 00010000:00010000:2.0:1782756269.160939:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756269.160943:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa199568 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.160950:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa199568 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756269.209552:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756269.209644:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210045824 00000100:00100000:1.0:1782756269.209658:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210045824 00000100:00100000:1.0:1782756269.210703:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 141 00000100:00100000:1.0:1782756269.210721:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+14:11322:x1869355210045824:12345-192.168.204.25@tcp:101:lctl.0 00010000:00010000:1.0:1782756269.210759:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756269.210794:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa19956f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce08c expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.212418:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5400/0x5e4fb0a8aa199576 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.212447:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5400/0x5e4fb0a8aa199576 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.212464:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5400/0x5e4fb0a8aa199576 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756269.212556:0:6579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782756269.212561:0:6579:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1782756269.212592:0:6579:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5400/0x5e4fb0a8aa199576 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.212630:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa19956f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce08c expref: 16 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.212649:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5400/0x5e4fb0a8aa199576 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce08c expref: 15 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.212658:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c4ef38800) 00010000:00010000:1.0:1782756269.212661:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782756269.212665:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef5400, rc 0) 00000100:00100000:1.0:1782756269.212759:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+15:11322:x1869355210045824:12345-192.168.204.25@tcp:101:lctl.0 Request processed in 2042us (3272us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756269.212779:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 141 00000100:00100000:1.0:1782756269.270419:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756269.270536:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210045952 00000100:00100000:2.0:1782756269.270549:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210045952 00000100:00100000:2.0:1782756269.270623:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 142 00000100:00100000:2.0:1782756269.270635:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+15:11328:x1869355210045952:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:2.0:1782756269.270663:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756269.270690:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19957d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce093 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.270778:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa199584 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.270798:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa199584 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.270814:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa199584 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.270834:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19958b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.270842:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19958b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.270872:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19958b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.271035:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa199592 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.271045:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa199592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.271052:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa199592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756269.271136:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1782756269.271141:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782756269.271184:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa199592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.271200:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa199584 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.271208:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa199584 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.271216:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa199584 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.271223:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d600 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756269.271228:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa199584 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.271236:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa199584 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.271259:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c4ef38800) 00010000:00010000:2.0:1782756269.271263:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756269.271269:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa199584 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.271276:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa199584 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.271296:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19958b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.271304:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19958b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.271310:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19958b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.271316:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756269.271319:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19958b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.271326:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19958b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.271334:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d3c58212d00) 00010000:00010000:2.0:1782756269.271336:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756269.271340:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19958b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.271345:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19958b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.271393:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19957d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce093 expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.271409:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa199592 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce093 expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.271416:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:2.0:1782756269.271418:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782756269.271420:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63dc00, rc 0) 00000100:00100000:2.0:1782756269.271518:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+16:11328:x1869355210045952:12345-192.168.204.25@tcp:101:bash.0 Request processed in 884us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756269.271527:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 142 00000100:00100000:2.0:1782756269.277209:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756269.277336:0:11978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210046208 00000100:00100000:0.0:1782756269.277349:0:11978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210046208 00000100:00100000:0.0:1782756269.277432:0:11978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 143 00000100:00100000:0.0:1782756269.277444:0:11978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+16:11328:x1869355210046208:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:0.0:1782756269.277472:0:11978:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756269.277496:0:11978:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199599 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce09a expref: -99 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.277686:0:11978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa1995a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.277705:0:11978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa1995a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.277720:0:11978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa1995a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.277958:0:11978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa1995a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.277982:0:11978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa1995a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.278022:0:11978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa1995a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782756269.279922:0:11978:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1782756269.280640:0:11978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1995ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.280658:0:11978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1995ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.280671:0:11978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1995ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.280713:0:11978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa1995a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.280720:0:11978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa1995a0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.280727:0:11978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa1995a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.280734:0:11978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81b000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756269.280739:0:11978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa1995a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.280746:0:11978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa1995a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.280758:0:11978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:0.0:1782756269.280762:0:11978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756269.280778:0:11978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa1995a0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.280785:0:11978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa1995a0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782756269.280800:0:11978:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000019731aa reply state 00000000c38c63ae transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa1995a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756269.280810:0:11978:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782756269.280934:0:11978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa199599 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce09a expref: 19 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.280950:0:11978:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1995ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce09a expref: 18 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.280957:0:11978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c54288a00) 00010000:00010000:0.0:1782756269.280959:0:11978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782756269.280961:0:11978:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81be00, rc 0) 00000100:00100000:1.0:1782756269.281679:0:11978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+19:11328:x1869355210046208:12345-192.168.204.25@tcp:101:bash.0 Request processed in 4233us (4480us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1782756269.281690:0:11978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 143 00010000:00010000:2.0:1782756269.285812:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa1995a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.285833:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa1995a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.285843:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa1995a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.285851:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81a000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756269.285857:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa1995a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.285871:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa1995a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.285923:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d3c54288000) 00010000:00010000:2.0:1782756269.285927:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756269.285933:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa1995a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.285941:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a000/0x5e4fb0a8aa1995a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756269.293529:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756269.293648:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210046336 00000100:00100000:3.0:1782756269.293665:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210046336 00000100:00100000:3.0:1782756269.293797:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 48 00000100:00100000:3.0:1782756269.295298:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78edb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+5:2355:x1869355210046336:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:3.0:1782756269.295327:0:6603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756269.295361:0:6603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9467ed8/0x5e4fb0a8aa1995bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce0a1 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782756269.295390:0:6603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782756269.295409:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=310s v=(0 0) 00010000:00010000:3.0:1782756269.295414:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756269.295425:0:6603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9467ed8/0x5e4fb0a8aa1995bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0a1 expref: 6 pid: 6603 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.295463:0:6603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d9467ed8/0x5e4fb0a8aa1995bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0a1 expref: 6 pid: 6603 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.295476:0:6603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168d200, rc 0) 00000100:00100000:3.0:1782756269.295535:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78edb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+6:2355:x1869355210046336:12345-192.168.204.25@tcp:101:bash.0 Request processed in 1729us (2025us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756269.295543:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 48 00000100:00100000:3.0:1782756269.307719:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756269.309608:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210046464 00000100:00100000:1.0:1782756269.309631:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210046464 00000100:00100000:1.0:1782756269.309828:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 49 00000100:00100000:1.0:1782756269.309841:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+6:11328:x1869355210046464:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:1.0:1782756269.309867:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756269.309894:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa1995c3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce0a8 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.309939:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9467ed8/0x5e4fb0a8aa1995bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0a1 expref: 7 pid: 6603 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.309950:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756269.309954:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756269.309960:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa1995c3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0a8 expref: 7 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.310024:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d9467ed8/0x5e4fb0a8aa1995bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0a1 expref: 7 pid: 6603 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.310042:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d9467ed8/0x5e4fb0a8aa1995bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0a1 expref: 7 pid: 6603 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756269.310127:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76d79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6605:1869355222631040:192.168.204.25@tcp:104: 00000100:00100000:1.0:1782756269.310276:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c542c8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782756269.317386:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76d79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6605:1869355222631040:192.168.204.25@tcp:104: 00010000:00010000:2.0:1782756269.317449:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa1995c3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0a8 expref: 7 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.317485:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef4c00, rc 0) 00000100:00100000:2.0:1782756269.317630:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+7:11328:x1869355210046464:12345-192.168.204.25@tcp:101:bash.0 Request processed in 7790us (9920us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756269.317642:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 49 00000100:00100000:3.0:1782756269.319818:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756269.324869:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210046592 00000100:00100000:1.0:1782756269.324891:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210046592 00010000:00010000:1.0:1782756269.324962:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d9467ed8/0x5e4fb0a8aa1995bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0a1 expref: 7 pid: 6603 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756269.325206:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 62 00000100:00100000:1.0:1782756269.325218:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43614e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26487635-60cb-4aee-af8e-396654f6c3d8+7:2356:x1869355210046592:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782756269.325240:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756269.325270:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d9467ed8/0x5e4fb0a8aa1995bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0a1 expref: 7 pid: 6603 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.325287:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d9467ed8/0x5e4fb0a8aa1995bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0a1 expref: 7 pid: 6603 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.325316:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9467ed8/0x5e4fb0a8aa1995bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0a1 expref: 7 pid: 6603 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.325339:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756269.325344:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756269.325353:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa1995c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0a8 expref: 6 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.325388:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa1995c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0a8 expref: 6 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.325438:0:5790:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa1995c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0a8 expref: 6 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756269.325456:0:5790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76d78000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5790:1869355222631168:192.168.204.25@tcp:105: 00000100:00100000:1.0:1782756269.325571:0:5790:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c542c8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782756269.339947:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756269.339966:0:5790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76d78000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5790:1869355222631168:192.168.204.25@tcp:105: 00010000:00010000:1.0:1782756269.340004:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782756269.340135:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43614e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26487635-60cb-4aee-af8e-396654f6c3d8+6:2356:x1869355210046592:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 14916us (20329us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756269.340148:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 62 00000100:00100000:2.0:1782756269.340220:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210046848 00000100:00100000:2.0:1782756269.340232:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210046848 00000100:00100000:2.0:1782756269.340307:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 36 00000100:00100000:2.0:1782756269.340320:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+18:11328:x1869355210046848:12345-192.168.204.25@tcp:35:bash.0 00000100:00100000:2.0:1782756269.341205:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+19:11328:x1869355210046848:12345-192.168.204.25@tcp:35:bash.0 Request processed in 882us (1264us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1782756269.341215:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 36 00000100:00100000:0.0:1782756269.430280:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756269.430645:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210047104 00000100:00100000:1.0:1782756269.430659:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210047104 00000100:00100000:1.0:1782756269.430744:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 144 00000100:00100000:1.0:1782756269.430758:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+19:11338:x1869355210047104:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1782756269.430793:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756269.430824:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1995ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce0af expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756269.431013:0:6579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1782756269.431226:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1995ca lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0af expref: 21 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.431260:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c4ef38800) 00010000:00010000:1.0:1782756269.431263:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782756269.431270:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1995ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0af expref: 21 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.431286:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef5000, rc 0) 00000100:00100000:1.0:1782756269.431375:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+20:11338:x1869355210047104:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 620us (1111us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1782756269.431384:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 144 00000100:00100000:1.0:1782756269.435621:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756269.441601:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210047360 00000100:00100000:0.0:1782756269.441620:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210047360 00000100:00100000:0.0:1782756269.441722:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 37 00000100:00100000:0.0:1782756269.441736:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+20:11338:x1869355210047360:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:0.0:1782756269.442135:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+21:11338:x1869355210047360:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 400us (6526us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1782756269.442145:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 37 00010000:00010000:1.0:1782756269.516585:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782756269.536671:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756269.536867:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210047488 00000100:00100000:0.0:1782756269.536900:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210047488 00000100:00100000:0.0:1782756269.536992:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 145 00000100:00100000:0.0:1782756269.537007:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+21:11344:x1869355210047488:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1782756269.537276:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756269.537309:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa1995d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce0b6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.537397:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa1995df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.537415:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa1995df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.537429:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa1995df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782756269.537731:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1782756269.537738:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782756269.537769:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa1995df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.537804:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa1995d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0b6 expref: 23 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.537830:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa1995df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0b6 expref: 22 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.537840:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:0.0:1782756269.537844:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782756269.537848:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81a200, rc 0) 00000100:00100000:0.0:1782756269.537938:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+22:11344:x1869355210047488:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 935us (1282us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756269.537947:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 145 00000100:00100000:3.0:1782756269.545416:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756269.545630:0:11978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210047744 00000100:00100000:1.0:1782756269.545644:0:11978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210047744 00000100:00100000:1.0:1782756269.545730:0:11978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 146 00000100:00100000:1.0:1782756269.545742:0:11978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+22:11344:x1869355210047744:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1782756269.545769:0:11978:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756269.545800:0:11978:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa1995e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce0bd expref: -99 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.545944:0:11978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4a00/0x5e4fb0a8aa1995ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.545961:0:11978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4a00/0x5e4fb0a8aa1995ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.545975:0:11978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4a00/0x5e4fb0a8aa1995ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756269.546013:0:11978:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1782756269.546715:0:11978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa1995e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0bd expref: 25 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.546741:0:11978:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4a00/0x5e4fb0a8aa1995ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0bd expref: 24 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.546750:0:11978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c54288a00) 00010000:00010000:1.0:1782756269.546754:0:11978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782756269.546757:0:11978:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef4a00, rc 0) 00000100:00100000:1.0:1782756269.546895:0:11978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+24:11344:x1869355210047744:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1154us (1506us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1782756269.546905:0:11978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 146 00000100:00100000:1.0:1782756269.550629:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756269.550741:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210048000 00000100:00100000:2.0:1782756269.550754:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210048000 00000100:00100000:2.0:1782756269.550866:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 147 00000100:00100000:2.0:1782756269.550880:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+24:11344:x1869355210048000:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1782756269.550914:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756269.550943:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa1995fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce0c4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.551126:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa199602 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.551142:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa199602 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.551153:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa199602 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756269.551178:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1782756269.551351:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa1995fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0c4 expref: 27 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.551375:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa199602 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0c4 expref: 26 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.551386:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c54288a00) 00010000:00010000:2.0:1782756269.551393:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1782756269.551397:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63d000, rc 0) 00000100:00100000:2.0:1782756269.551473:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+26:11344:x1869355210048000:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 595us (858us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1782756269.551482:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 147 00000100:00100000:0.0:1782756269.552743:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756269.552823:0:8367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210048128 00000100:00100000:1.0:1782756269.552834:0:8367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210048128 00000100:00100000:1.0:1782756269.552902:0:8367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 11 00000100:00100000:1.0:1782756269.552924:0:8367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77042680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26487635-60cb-4aee-af8e-396654f6c3d8+26:2355:x1869355210048128:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782756269.552942:0:8367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756269.552972:0:8367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4a00/0x5e4fb0a8aa1995ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0bd expref: 26 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.552994:0:8367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c54288a00) 00010000:00010000:1.0:1782756269.552998:0:8367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782756269.553169:0:8367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77042680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26487635-60cb-4aee-af8e-396654f6c3d8+25:2355:x1869355210048128:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 247us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756269.553196:0:8367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 11 00000100:00100000:0.0:1782756269.564432:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756269.564647:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210048256 00000100:00100000:1.0:1782756269.564662:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210048256 00000100:00100000:1.0:1782756269.564804:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 50 00000100:00100000:1.0:1782756269.564817:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+6:2356:x1869355210048256:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:1.0:1782756269.564876:0:6602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199610 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.564902:0:6602:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa1995c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0a8 expref: 6 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.564913:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756269.564917:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782756269.564922:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199610 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.564990:0:6602:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa1995c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0a8 expref: 6 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.565007:0:6602:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa1995c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0a8 expref: 6 pid: 6605 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756269.565026:0:6602:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76d79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6602:1869355222631296:192.168.204.25@tcp:104: 00000100:00100000:1.0:1782756269.565188:0:6602:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c542c8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782756269.569683:0:6602:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76d79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6602:1869355222631296:192.168.204.25@tcp:104: 00010000:00010000:1.0:1782756269.569748:0:6602:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199610 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756269.570980:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756269.571149:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210048384 00000100:00100000:2.0:1782756269.571187:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210048384 00002000:00100000:2.0:1782756269.571256:0:6608:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9d3c77041500 x1869355210048384/t0(0) o4->26487635-60cb-4aee-af8e-396654f6c3d8@192.168.204.25@tcp:450/0 lens 504/0 e 0 to 0 dl 1782756280 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782756269.571268:0:6608:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3c77041500 with x1869355210048384 ext(0->12) 00010000:00010000:2.0:1782756269.571279:0:6608:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa1995c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0a8 expref: 7 pid: 6605 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.571298:0:6608:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa1995c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0a8 expref: 7 pid: 6605 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782756269.571307:0:6608:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d3c77041500 00000100:00100000:2.0:1782756269.571350:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1 00000100:00100000:2.0:1782756269.571362:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77041500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26487635-60cb-4aee-af8e-396654f6c3d8+7:2355:x1869355210048384:12345-192.168.204.25@tcp:4:lfs.0 00000100:00100000:2.0:1782756269.572125:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77041500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26487635-60cb-4aee-af8e-396654f6c3d8+9:2355:x1869355210048384:12345-192.168.204.25@tcp:4:lfs.0 Request processed in 714us (1112us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1782756269.572135:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1 00002000:00100000:2.0:1782756269.572146:0:6608:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9d3c77041500 x1869355210048384/t4294967305(0) o4->26487635-60cb-4aee-af8e-396654f6c3d8@192.168.204.25@tcp:450/0 lens 504/448 e 0 to 0 dl 1782756280 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782756269.572165:0:6608:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3c77041500 with x1869355210048384 ext(0->12) 00010000:00010000:2.0:1782756269.572173:0:6608:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa1995c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0a8 expref: 9 pid: 6605 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.572189:0:6608:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa1995c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0a8 expref: 9 pid: 6605 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782756269.572209:0:6608:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d3c77041500 00000100:00100000:2.0:1782756269.575539:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756269.578416:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210048512 00000100:00100000:0.0:1782756269.578436:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210048512 00010000:00010000:0.0:1782756269.578509:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa1995c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0a8 expref: 9 pid: 6605 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756269.580774:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 63 00000100:00100000:0.0:1782756269.580807:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ed8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+9:2356:x1869355210048512:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782756269.580834:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1782756269.580863:0:5788:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1782756269.580867:0:5788:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1782756268 00002000:00010000:0.0:1782756269.580869:0:5788:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1782756269 00002000:00010000:0.0:1782756269.580872:0:5788:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1782756268 00010000:00010000:0.0:1782756269.580879:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa1995c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0a8 expref: 9 pid: 6605 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.580900:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa1995c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0a8 expref: 9 pid: 6605 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.580931:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa1995c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0a8 expref: 9 pid: 6605 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.580990:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782756269.580995:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782756269.581002:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199610 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.581013:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199610 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.581056:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756269.581195:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ed8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+8:2356:x1869355210048512:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 403us (5669us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756269.581205:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 63 00010000:00010000:1.0:1782756269.581312:0:6602:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199610 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.581325:0:6602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199610 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.581358:0:6602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199610 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.581368:0:6602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199610 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.581377:0:6602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199610 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.581385:0:6602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4a00 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:1.0:1782756269.581390:0:6602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199610 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.581399:0:6602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199610 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.581414:0:6602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199610 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.581431:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199610 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756269.581491:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+7:2356:x1869355210048256:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 16677us (17074us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756269.581501:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 50 00000100:00100000:0.0:1782756269.584599:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756269.584767:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210048768 00000100:00100000:3.0:1782756269.584782:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210048768 00000100:00100000:3.0:1782756269.584863:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 38 00000100:00100000:3.0:1782756269.584877:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c49778050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+25:11344:x1869355210048768:12345-192.168.204.25@tcp:35:lfs.0 00000004:00010000:3.0:1782756269.584978:0:5807:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa199602 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0c4 expref: 25 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782756269.585380:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1782756269.585426:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1782756269.586142:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1782756269.586235:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199617 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.586258:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1995ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce09a expref: 29 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.586284:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199617 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.586333:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1995ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce09a expref: 29 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.586354:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1995ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce09a expref: 29 pid: 11978 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756269.586374:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b43616d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5807:1869355222631424:192.168.204.25@tcp:104: 00000100:00100000:3.0:1782756269.586507:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78a50180 going to sleep for 11 seconds 00000100:00100000:3.0:1782756269.590048:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756269.590726:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210048896 00000100:00100000:2.0:1782756269.590740:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210048896 00010000:00010000:2.0:1782756269.590795:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1995ae lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce09a expref: 30 pid: 11978 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756269.590879:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 64 00000100:00100000:2.0:1782756269.590891:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c501d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+30:2356:x1869355210048896:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782756269.590912:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756269.590920:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1995ae lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce09a expref: 30 pid: 11978 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.590936:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1995ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce09a expref: 30 pid: 11978 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.590972:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c54288a00) 00010000:00010000:2.0:1782756269.590978:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199617 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.590990:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199617 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.590999:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199617 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.591031:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756269.591326:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c501d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+30:2356:x1869355210048896:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 435us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756269.591336:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 64 00010000:00010000:0.0:1782756269.591503:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1995ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce09a expref: 29 pid: 11978 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756269.591522:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b43616d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5807:1869355222631424:192.168.204.25@tcp:104: 00010000:00010000:0.0:1782756269.591551:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199617 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.591561:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199617 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756269.591566:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199617 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782756269.591758:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1782756269.592048:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1782756269.592441:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c77040700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1869355222631552:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782756269.592518:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756269.592557:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78ef9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782756269.592708:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222631552 00000100:00100000:3.0:1782756269.592716:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222631552 00000100:00100000:3.0:1782756269.592775:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782756269.592786:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5807:x1869355222631552:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1782756269.592874:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5807:x1869355222631552:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 90us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756269.592882:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782756269.593672:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c77040700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1869355222631552:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1782756269.595023:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1782756269.595700:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c77040700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1869355222631680:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782756269.595783:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756269.595908:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78ef9480 going to sleep for 11 seconds 00000100:00100000:3.0:1782756269.596324:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222631680 00000100:00100000:3.0:1782756269.596334:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222631680 00000100:00100000:3.0:1782756269.596441:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782756269.596676:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5807:x1869355222631680:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1782756269.597041:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5807:x1869355222631680:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 368us (1257us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1782756269.597061:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782756269.597201:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c77040700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1869355222631680:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1782756269.597295:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1782756269.597367:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199617 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.597379:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199617 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.597388:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199617 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.597812:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168d600 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756269.597819:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199617 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.597829:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199617 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.597915:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c54288a00) 00010000:00010000:1.0:1782756269.597920:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1782756269.597925:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199617 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.597947:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199617 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782756269.599390:0:5807:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1782756269.599833:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1782756269.599925:0:5807:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 310834849242ns, next at 311834845827ns, rc = 0 00000001:00080000:1.0:1782756269.599938:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1782756269.601948:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c54288a00) 00010000:00010000:1.0:1782756269.601959:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1782756269.601973:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa199602 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0c4 expref: 33 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756269.602826:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c49778050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+32:11344:x1869355210048768:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 17946us (18248us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1782756269.602849:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 38 00000020:00080000:1.0:1782756269.602858:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1782756269.605528:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756269.605687:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210049024 00000100:00100000:2.0:1782756269.605700:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210049024 00000100:00100000:2.0:1782756269.605823:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 148 00000100:00100000:2.0:1782756269.605837:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+32:11344:x1869355210049024:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1782756269.605872:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756269.605908:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa19961e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce0cb expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.605997:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa19961e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0cb expref: 33 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.606027:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa19961e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0cb expref: 33 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.606052:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212d00) 00010000:00010000:2.0:1782756269.606056:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782756269.606059:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63d200, rc 0) 00000100:00100000:2.0:1782756269.606183:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+33:11344:x1869355210049024:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 349us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756269.606191:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 148 00000100:00100000:1.0:1782756269.609638:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756269.609788:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210049280 00000100:00100000:3.0:1782756269.609800:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210049280 00000100:00100000:3.0:1782756269.609912:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 39 00000100:00100000:3.0:1782756269.609926:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+33:11344:x1869355210049280:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:3.0:1782756269.610303:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+34:11344:x1869355210049280:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 379us (679us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1782756269.610312:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 39 00000100:00100000:3.0:1782756269.702289:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756269.703372:0:11978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210049536 00000100:00100000:1.0:1782756269.703390:0:11978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210049536 00000100:00100000:1.0:1782756269.703684:0:11978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 149 00000100:00100000:1.0:1782756269.703699:0:11978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+34:11354:x1869355210049536:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1782756269.703738:0:11978:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756269.703767:0:11978:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4a00/0x5e4fb0a8aa199625 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce0d2 expref: -99 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756269.703939:0:11978:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1782756269.704237:0:11978:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4a00/0x5e4fb0a8aa199625 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0d2 expref: 36 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.704277:0:11978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c4ef38800) 00010000:00010000:1.0:1782756269.704280:0:11978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782756269.704287:0:11978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4a00/0x5e4fb0a8aa199625 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0d2 expref: 36 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.704303:0:11978:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef4a00, rc 0) 00000100:00100000:1.0:1782756269.704402:0:11978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+35:11354:x1869355210049536:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 706us (2135us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1782756269.704419:0:11978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 149 00000100:00100000:0.0:1782756269.716457:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756269.716569:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210049664 00000100:00100000:3.0:1782756269.716583:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210049664 00000100:00100000:3.0:1782756269.716658:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 150 00000100:00100000:3.0:1782756269.716672:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+35:11354:x1869355210049664:12345-192.168.204.25@tcp:34:lfs.0 00010000:00010000:3.0:1782756269.716786:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199633 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.716807:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199633 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.716822:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199633 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.716838:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa19963a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.716846:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa19963a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.716853:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa19963a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.717035:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199641 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.717045:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199641 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.717052:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199641 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782756269.717166:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199641 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.717183:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199633 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.717190:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199633 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.717198:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199633 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.717205:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168ca00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756269.717209:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199633 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.717218:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199633 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.717233:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:3.0:1782756269.717237:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756269.717244:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199633 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.717259:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199633 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.717279:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa19963a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.717286:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa19963a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.717293:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa19963a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.717298:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168cc00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756269.717302:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa19963a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.717307:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa19963a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.717316:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d3c49e15900) 00010000:00010000:3.0:1782756269.717319:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756269.717322:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa19963a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.717327:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa19963a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.717343:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199641 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.717348:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199641 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.717361:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199641 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.717367:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168c200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756269.717370:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199641 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.717376:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199641 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.717384:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212d00) 00010000:00010000:3.0:1782756269.717387:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756269.717390:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199641 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756269.717397:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199641 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756269.717497:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+35:11354:x1869355210049664:12345-192.168.204.25@tcp:34:lfs.0 Request processed in 826us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756269.717507:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 150 00000100:00100000:2.0:1782756269.721677:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756269.721795:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210049920 00000100:00100000:1.0:1782756269.721809:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210049920 00000100:00100000:1.0:1782756269.721888:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 40 00000100:00100000:1.0:1782756269.721900:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+35:11354:x1869355210049920:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:1.0:1782756269.722318:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+36:11354:x1869355210049920:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 419us (656us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1782756269.722327:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 40 00000100:00100000:3.0:1782756269.773568:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756269.773757:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210050176 00000100:00100000:2.0:1782756269.773771:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210050176 00000100:00100000:2.0:1782756269.773843:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 151 00000100:00100000:2.0:1782756269.773854:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+36:11357:x1869355210050176:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1782756269.773909:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756269.773939:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa199648 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce0d9 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.774040:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19964f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.774059:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19964f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.774115:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19964f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.774140:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199656 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.774148:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199656 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.774165:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199656 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.774840:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19965d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.774854:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19965d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.774863:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19965d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756269.774876:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1782756269.775028:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19964f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.775037:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19964f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.775044:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19964f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.775051:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756269.775056:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19964f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.775064:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19964f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.775109:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:2.0:1782756269.775113:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756269.775119:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19964f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.775137:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19964f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.775161:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199656 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.775168:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199656 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.775174:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199656 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.775190:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63c000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756269.775193:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199656 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.775200:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199656 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.775288:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d3c58212700) 00010000:00010000:2.0:1782756269.775291:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756269.775295:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199656 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.775302:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199656 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.775362:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa199648 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0d9 expref: 39 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.775604:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19965d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0d9 expref: 38 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756269.775613:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212d00) 00010000:00010000:2.0:1782756269.775616:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782756269.775618:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63d600, rc 0) 00000100:00100000:2.0:1782756269.775717:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+38:11357:x1869355210050176:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1862us (2163us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1782756269.775727:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 151 00000100:00100000:0.0:1782756269.778757:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756269.778925:0:11978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210050304 00000100:00100000:1.0:1782756269.778937:0:11978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210050304 00000100:00100000:1.0:1782756269.779061:0:11978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 152 00000100:00100000:1.0:1782756269.779103:0:11978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+38:11357:x1869355210050304:12345-192.168.204.25@tcp:54:lfs.0 00010000:00010000:1.0:1782756269.779213:0:11978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa19966b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.779244:0:11978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa19966b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.779281:0:11978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa19966b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.779317:0:11978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa19966b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.779324:0:11978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa19966b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.779331:0:11978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa19966b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.779337:0:11978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4400 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756269.779342:0:11978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa19966b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.779350:0:11978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa19966b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.779373:0:11978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212d00) 00010000:00010000:1.0:1782756269.779376:0:11978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782756269.779382:0:11978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa19966b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756269.779388:0:11978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa19966b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756269.779485:0:11978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+38:11357:x1869355210050304:12345-192.168.204.25@tcp:54:lfs.0 Request processed in 413us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756269.779495:0:11978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 152 00000100:00100000:1.0:1782756269.782460:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756269.782654:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210050560 00000100:00100000:2.0:1782756269.782684:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210050560 00000100:00100000:2.0:1782756269.782802:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 41 00000100:00100000:2.0:1782756269.782818:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+38:11357:x1869355210050560:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:2.0:1782756269.784562:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+39:11357:x1869355210050560:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 1736us (2102us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1782756269.785523:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 41 00000100:00100000:0.0:1782756270.051358:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756270.051584:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210050816 00000100:00100000:1.0:1782756270.051597:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210050816 00000100:00100000:1.0:1782756270.051686:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 153 00000100:00100000:1.0:1782756270.051698:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+39:11388:x1869355210050816:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1782756270.051809:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756270.051837:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199672 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce0e0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.051977:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa199679 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.051994:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa199679 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.052120:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa199679 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756270.052137:0:6579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1782756270.052688:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199672 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0e0 expref: 42 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.052783:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa199679 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0e0 expref: 41 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.052796:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212d00) 00010000:00010000:1.0:1782756270.052800:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782756270.052804:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef4e00, rc 0) 00000100:00100000:1.0:1782756270.052930:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+41:11388:x1869355210050816:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1233us (1587us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1782756270.052957:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 153 00000100:00100000:0.0:1782756270.062402:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756270.062514:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210051072 00000100:00100000:3.0:1782756270.062526:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210051072 00000100:00100000:3.0:1782756270.062607:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 42 00000100:00100000:3.0:1782756270.062619:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+41:11388:x1869355210051072:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1782756270.063050:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+42:11388:x1869355210051072:12345-192.168.204.25@tcp:35:cat.0 Request processed in 432us (665us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1782756270.063284:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 42 00000100:00100000:2.0:1782756270.066132:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756270.066242:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210051200 00000100:00100000:3.0:1782756270.066256:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210051200 00000100:00100000:3.0:1782756270.066332:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 12 00000100:00100000:3.0:1782756270.066345:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26487635-60cb-4aee-af8e-396654f6c3d8+42:2355:x1869355210051200:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782756270.066366:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756270.066399:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa199679 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0e0 expref: 42 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.066580:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212d00) 00010000:00010000:3.0:1782756270.066586:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782756270.066933:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26487635-60cb-4aee-af8e-396654f6c3d8+41:2355:x1869355210051200:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 589us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756270.066942:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 12 00000100:00100000:0.0:1782756270.133807:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756270.133973:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210051456 00000100:00100000:2.0:1782756270.133985:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210051456 00000100:00100000:2.0:1782756270.134214:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 154 00000100:00100000:2.0:1782756270.134227:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+41:11394:x1869355210051456:12345-192.168.204.25@tcp:101:dd.0 00010000:00010000:2.0:1782756270.134261:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756270.134265:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782756270.134304:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa1995df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0b6 expref: 41 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.134327:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:2.0:1782756270.134333:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782756270.134351:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199687 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce0e7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.134486:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19968e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.134503:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19965d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0d9 expref: 41 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.134513:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19968e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.134571:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19965d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0d9 expref: 41 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.134587:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19965d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0d9 expref: 41 pid: 5803 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756270.134605:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c79dfb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1869355222631808:192.168.204.25@tcp:104: 00000100:00100000:2.0:1782756270.134804:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c50115240 going to sleep for 11 seconds 00000100:00100000:2.0:1782756270.137947:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c79dfb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1869355222631808:192.168.204.25@tcp:104: 00010000:00010000:2.0:1782756270.137992:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19968e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756270.138657:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756270.139014:0:8367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210051584 00000100:00100000:1.0:1782756270.139026:0:8367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210051584 00010000:00010000:1.0:1782756270.139231:0:8367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19965d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0d9 expref: 42 pid: 5803 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756270.139313:0:8367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 65 00000100:00100000:1.0:1782756270.139326:0:8367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77042a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26487635-60cb-4aee-af8e-396654f6c3d8+42:2355:x1869355210051584:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782756270.139348:0:8367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756270.139356:0:8367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19965d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0d9 expref: 42 pid: 5803 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.139371:0:8367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19965d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0d9 expref: 42 pid: 5803 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.139398:0:8367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19965d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0d9 expref: 42 pid: 5803 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.139420:0:8367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212d00) 00010000:00010000:1.0:1782756270.139426:0:8367:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19968e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.139450:0:8367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19968e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.139458:0:8367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19968e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.139523:0:8367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782756270.139609:0:8367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77042a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26487635-60cb-4aee-af8e-396654f6c3d8+41:2355:x1869355210051584:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 284us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756270.139618:0:8367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 65 00010000:00010000:0.0:1782756270.143066:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19968e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756270.143113:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19968e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782756270.143155:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1782756270.143397:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199687 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0e7 expref: 42 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756270.143425:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19968e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0e7 expref: 41 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756270.143460:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212d00) 00010000:00010000:0.0:1782756270.143463:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782756270.143468:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63d000, rc 0) 00000100:00100000:0.0:1782756270.143577:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+41:11394:x1869355210051456:12345-192.168.204.25@tcp:101:dd.0 Request processed in 9352us (9785us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1782756270.143588:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 154 00000100:00100000:3.0:1782756270.147236:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756270.147361:0:11978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210051840 00000100:00100000:1.0:1782756270.147374:0:11978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210051840 00000100:00100000:1.0:1782756270.147447:0:11978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 155 00000100:00100000:1.0:1782756270.147459:0:11978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+41:11394:x1869355210051840:12345-192.168.204.25@tcp:36:dd.0 00010000:00010000:1.0:1782756270.147847:0:11978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19969c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.147870:0:11978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19969c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.147884:0:11978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19969c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782756270.147946:0:11978:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1782756270.147973:0:11978:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003447b62f reply state 00000000a68a8170 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19969c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756270.147983:0:11978:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782756270.148124:0:11978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+44:11394:x1869355210051840:12345-192.168.204.25@tcp:36:dd.0 Request processed in 664us (898us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1782756270.148134:0:11978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 155 00000020:00080000:1.0:1782756270.148140:0:11978:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1782756270.153954:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19969c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.153979:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19969c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.153988:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19969c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.153995:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756270.154002:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19969c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.154011:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19969c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.154325:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212d00) 00010000:00010000:2.0:1782756270.154352:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756270.154360:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19969c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.154368:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19969c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756270.343413:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756270.345697:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210051968 00000100:00100000:1.0:1782756270.345720:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210051968 00000100:00100000:1.0:1782756270.347310:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 156 00000100:00100000:1.0:1782756270.347356:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43615500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+43:11408:x1869355210051968:12345-192.168.204.25@tcp:101:stat.0 00010000:00010000:1.0:1782756270.347393:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756270.347422:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1996a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce0ee expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.347685:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1996aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.347704:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1996aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.347718:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1996aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.347736:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1996b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.347744:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1996b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.347751:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1996b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.347902:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1996b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.347915:0:6579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19968e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0e7 expref: 44 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.347938:0:6579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1996b8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.347998:0:6579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19968e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0e7 expref: 44 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.348016:0:6579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19968e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0e7 expref: 44 pid: 5803 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756270.348034:0:6579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76d7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6579:1869355222631936:192.168.204.25@tcp:104: 00000100:00100000:1.0:1782756270.348536:0:6579:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c542c8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782756270.351637:0:6579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76d7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6579:1869355222631936:192.168.204.25@tcp:104: 00010000:00010000:1.0:1782756270.351746:0:6579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1996b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756270.351932:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756270.352114:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210052224 00000100:00100000:2.0:1782756270.352124:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210052224 00000100:00100000:2.0:1782756270.352214:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 43 00000100:00100000:2.0:1782756270.352226:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+45:5577:x1869355210052224:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1782756270.353833:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+46:5577:x1869355210052224:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 1593us (1886us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1782756270.353848:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 43 00000100:00100000:3.0:1782756270.356357:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756270.356439:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210052352 00000100:00100000:0.0:1782756270.356452:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210052352 00010000:00010000:0.0:1782756270.356505:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19968e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0e7 expref: 46 pid: 5803 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756270.356608:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 66 00000100:00100000:0.0:1782756270.356622:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43615880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+46:2355:x1869355210052352:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782756270.356642:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756270.356650:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19968e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0e7 expref: 46 pid: 5803 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756270.356667:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19968e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0e7 expref: 46 pid: 5803 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756270.356695:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19968e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0e7 expref: 46 pid: 5803 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756270.356717:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212d00) 00010000:00010000:0.0:1782756270.356723:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1996b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756270.356750:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1996b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756270.356759:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1996b8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756270.356798:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756270.356877:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43615880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+45:2355:x1869355210052352:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 258us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756270.356885:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 66 00010000:00010000:1.0:1782756270.356946:0:6579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1996b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.356956:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1996b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756270.357016:0:6579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1782756270.357022:0:6579:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782756270.357050:0:6579:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1996b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.357066:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1996b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.357102:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1996aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.357126:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1996aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.357133:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1996aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.357155:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5c00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756270.357160:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1996aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.357169:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1996aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.357178:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:1.0:1782756270.357181:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756270.357186:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1996aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.357192:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1996aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.357205:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1996b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.357210:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1996b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.357216:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1996b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.357222:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4800 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756270.357231:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1996b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.357238:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1996b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.357247:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d3c4ef38500) 00010000:00010000:1.0:1782756270.357250:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756270.357254:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1996b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.357260:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1996b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.357305:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1996a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0ee expref: 45 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.357327:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1996b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0ee expref: 44 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.357335:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212d00) 00010000:00010000:1.0:1782756270.357338:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782756270.357341:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef4000, rc 0) 00000100:00100000:1.0:1782756270.357372:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43615500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+44:11408:x1869355210051968:12345-192.168.204.25@tcp:101:stat.0 Request processed in 10026us (13977us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756270.357380:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 156 00000100:00100000:3.0:1782756270.399128:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756270.399276:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210052608 00000100:00100000:0.0:1782756270.399290:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210052608 00000100:00100000:0.0:1782756270.399447:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 157 00000100:00100000:0.0:1782756270.399467:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+44:11414:x1869355210052608:12345-192.168.204.25@tcp:36:truncate.0 00010000:00010000:0.0:1782756270.399553:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756270.399593:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1996b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0ee expref: 44 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756270.399620:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212d00) 00010000:00010000:0.0:1782756270.399626:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782756270.399916:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1996bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756270.399934:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1996bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756270.399946:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1996bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782756270.400033:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1782756270.400061:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000cc05fd1 reply state 000000000b20bd64 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1996bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756270.400071:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782756270.400268:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+46:11414:x1869355210052608:12345-192.168.204.25@tcp:36:truncate.0 Request processed in 802us (1189us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1782756270.400276:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 157 00000020:00080000:0.0:1782756270.400283:0:5803:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782756270.402022:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1996bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.402046:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1996bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.402054:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1996bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.402113:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81aa00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756270.402119:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1996bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.402128:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1996bf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.402162:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212d00) 00010000:00010000:3.0:1782756270.402166:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756270.402171:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1996bf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.402178:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1996bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756270.503734:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756270.503959:0:11978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210052736 00000100:00100000:1.0:1782756270.503974:0:11978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210052736 00000100:00100000:1.0:1782756270.504057:0:11978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 158 00000100:00100000:1.0:1782756270.504071:0:11978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+45:11428:x1869355210052736:12345-192.168.204.25@tcp:101:stat.0 00010000:00010000:1.0:1782756270.504177:0:11978:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756270.504205:0:11978:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1996c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce0f5 expref: -99 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.504295:0:11978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1996cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.504314:0:11978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1996cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.504327:0:11978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1996cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.504343:0:11978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1996d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.504350:0:11978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1996d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.504358:0:11978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1996d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.504490:0:11978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1996db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.504499:0:11978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1996db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.504507:0:11978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1996db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756270.504557:0:11978:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1782756270.504568:0:11978:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782756270.504595:0:11978:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1996db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.504608:0:11978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1996db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.504617:0:11978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1996cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.504623:0:11978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1996cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.504630:0:11978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1996cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.504637:0:11978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4800 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756270.504642:0:11978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1996cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.504650:0:11978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1996cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.504665:0:11978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:1.0:1782756270.504668:0:11978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756270.504673:0:11978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1996cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.504681:0:11978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1996cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.504697:0:11978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1996d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.504713:0:11978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1996d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.504719:0:11978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1996d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.504724:0:11978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5c00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756270.504727:0:11978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1996d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.504734:0:11978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1996d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.504742:0:11978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d3c4ef38500) 00010000:00010000:1.0:1782756270.504745:0:11978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756270.504748:0:11978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1996d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.504754:0:11978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1996d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.504792:0:11978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1996c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0f5 expref: 47 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.504808:0:11978:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1996db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0f5 expref: 46 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.504817:0:11978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212d00) 00010000:00010000:1.0:1782756270.504819:0:11978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782756270.504828:0:11978:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef4200, rc 0) 00000100:00100000:1.0:1782756270.504910:0:11978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+46:11428:x1869355210052736:12345-192.168.204.25@tcp:101:stat.0 Request processed in 842us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756270.504921:0:11978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 158 00010000:00010000:3.0:1782756270.542621:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782756270.576205:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756270.576346:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210052992 00000100:00100000:1.0:1782756270.576358:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210052992 00000100:00100000:1.0:1782756270.576439:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 159 00000100:00100000:1.0:1782756270.576452:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+46:11438:x1869355210052992:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1782756270.576484:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756270.576513:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1996e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce0fc expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756270.576671:0:6579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1782756270.576825:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1996e2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0fc expref: 48 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.576842:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c4ef38800) 00010000:00010000:1.0:1782756270.576846:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782756270.576852:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1996e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0fc expref: 48 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.576868:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef5a00, rc 0) 00000100:00100000:1.0:1782756270.576952:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+47:11438:x1869355210052992:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 503us (762us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1782756270.576960:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 159 00000100:00100000:3.0:1782756270.582745:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756270.582835:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210053248 00000100:00100000:1.0:1782756270.582848:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210053248 00000100:00100000:1.0:1782756270.582918:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 44 00000100:00100000:1.0:1782756270.582946:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4977b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+47:11438:x1869355210053248:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:1.0:1782756270.583337:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4977b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+48:11438:x1869355210053248:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 391us (604us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1782756270.583347:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 44 00000001:00080000:0.0:1782756270.606955:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1782756270.606980:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:0.0:1782756270.637259:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756270.638490:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210053504 00000100:00100000:2.0:1782756270.638504:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210053504 00000100:00100000:2.0:1782756270.638586:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 160 00000100:00100000:2.0:1782756270.638596:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+48:11444:x1869355210053504:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:2.0:1782756270.638623:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756270.638643:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa1996f0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce103 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.638741:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa1996f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.638757:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1996db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0f5 expref: 49 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.638766:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa1996f7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.638815:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1996db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0f5 expref: 49 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.638828:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1996db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0f5 expref: 49 pid: 11978 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756270.638841:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c79dfb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1869355222632064:192.168.204.25@tcp:104: 00000100:00100000:2.0:1782756270.638943:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76d17f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782756270.644546:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c79dfb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1869355222632064:192.168.204.25@tcp:104: 00010000:00010000:2.0:1782756270.644590:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa1996f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756270.644795:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756270.645264:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210053632 00000100:00100000:2.0:1782756270.645274:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210053632 00010000:00010000:3.0:1782756270.645543:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1996db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0f5 expref: 50 pid: 11978 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756270.645583:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 67 00000100:00100000:3.0:1782756270.645591:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77042300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+50:2355:x1869355210053632:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782756270.645608:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756270.645614:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1996db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0f5 expref: 50 pid: 11978 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.645641:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1996db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0f5 expref: 50 pid: 11978 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.645664:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1996db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0f5 expref: 50 pid: 11978 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.645679:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212d00) 00010000:00010000:3.0:1782756270.645683:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa1996f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.645692:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa1996f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.645698:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa1996f7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.645719:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782756270.645750:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa1996f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.645758:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa1996f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756270.645781:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000100:00100000:3.0:1782756270.645789:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77042300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+49:2355:x1869355210053632:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 197us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756270.645796:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 67 00010000:00010000:3.0:1782756270.647254:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa1996f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce103 expref: 50 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.647283:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa1996f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce103 expref: 49 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.647291:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212d00) 00010000:00010000:3.0:1782756270.647308:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782756270.647311:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63d000, rc 0) 00000100:00100000:3.0:1782756270.647385:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+49:11444:x1869355210053504:12345-192.168.204.25@tcp:101:bash.0 Request processed in 8789us (10141us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1782756270.647394:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 160 00000100:00100000:0.0:1782756270.653442:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756270.653568:0:11978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210053888 00000100:00100000:1.0:1782756270.653578:0:11978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210053888 00000100:00100000:1.0:1782756270.653682:0:11978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 161 00000100:00100000:1.0:1782756270.653693:0:11978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+49:11444:x1869355210053888:12345-192.168.204.25@tcp:36:bash.0 00010000:00010000:1.0:1782756270.653964:0:11978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa199705 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.654053:0:11978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa199705 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.654065:0:11978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa199705 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782756270.654211:0:11978:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1782756270.654248:0:11978:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006df2ba57 reply state 0000000051e37fce transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa199705 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756270.654258:0:11978:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782756270.654356:0:11978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+52:11444:x1869355210053888:12345-192.168.204.25@tcp:36:bash.0 Request processed in 664us (924us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1782756270.654364:0:11978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 161 00000020:00080000:1.0:1782756270.654369:0:11978:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1782756270.658608:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa199705 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.658626:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa199705 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.658634:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa199705 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.658658:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5a00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756270.658663:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa199705 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.658671:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa199705 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.658687:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212d00) 00010000:00010000:2.0:1782756270.658690:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756270.658695:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa199705 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.658701:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa199705 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756270.659726:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756270.659815:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210054016 00000100:00100000:3.0:1782756270.659825:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210054016 00000100:00100000:3.0:1782756270.659884:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 162 00000100:00100000:3.0:1782756270.659894:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+51:11444:x1869355210054016:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:3.0:1782756270.659918:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756270.659937:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa19970c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce10a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.660016:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199713 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.660030:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa1996f7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce103 expref: 52 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.660039:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199713 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.660362:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa1996f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce103 expref: 52 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.660377:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa1996f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce103 expref: 52 pid: 5803 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756270.660391:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b43617100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1869355222632192:192.168.204.25@tcp:104: 00000100:00100000:3.0:1782756270.660529:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78a500c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782756270.665048:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756270.666260:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210054144 00000100:00100000:1.0:1782756270.666272:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210054144 00010000:00010000:1.0:1782756270.666318:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa1996f7 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce103 expref: 53 pid: 5803 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756270.666372:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 68 00000100:00100000:1.0:1782756270.666382:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77041f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26487635-60cb-4aee-af8e-396654f6c3d8+53:2356:x1869355210054144:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782756270.666399:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756270.666407:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa1996f7 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce103 expref: 53 pid: 5803 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.666420:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa1996f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce103 expref: 53 pid: 5803 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.666444:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212d00) 00010000:00010000:1.0:1782756270.666449:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199713 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.666458:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199713 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.666465:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199713 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.666485:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782756270.667197:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77041f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26487635-60cb-4aee-af8e-396654f6c3d8+53:2356:x1869355210054144:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 812us (2154us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756270.667206:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 68 00010000:00010000:3.0:1782756270.668260:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa1996f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce103 expref: 52 pid: 5803 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756270.668296:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b43617100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1869355222632192:192.168.204.25@tcp:104: 00010000:00010000:3.0:1782756270.668332:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199713 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.668408:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199713 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.668423:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199713 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756270.668479:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1782756270.668484:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782756270.668509:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199713 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.668628:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa19970c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce10a expref: 52 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.668650:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199713 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce10a expref: 51 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.668675:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212d00) 00010000:00010000:2.0:1782756270.668678:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782756270.668681:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168c200, rc 0) 00000100:00100000:2.0:1782756270.669472:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+51:11444:x1869355210054016:12345-192.168.204.25@tcp:101:bash.0 Request processed in 9574us (9750us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756270.669480:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 162 00000100:00100000:0.0:1782756270.672164:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756270.672470:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210054400 00000100:00100000:1.0:1782756270.672483:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210054400 00000100:00100000:1.0:1782756270.672557:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 45 00000100:00100000:1.0:1782756270.672569:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+51:11444:x1869355210054400:12345-192.168.204.25@tcp:35:bash.0 00000100:00100000:1.0:1782756270.673395:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+52:11444:x1869355210054400:12345-192.168.204.25@tcp:35:bash.0 Request processed in 813us (1243us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1782756270.673413:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 45 00000100:00100000:0.0:1782756270.735350:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756270.735435:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210054656 00000100:00100000:3.0:1782756270.735544:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210054656 00000100:00100000:3.0:1782756270.735633:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 163 00000100:00100000:3.0:1782756270.735645:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+52:11453:x1869355210054656:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1782756270.735677:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756270.735704:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa19971a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce111 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782756270.735862:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1782756270.736030:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa19971a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce111 expref: 54 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.736047:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c4ef38800) 00010000:00010000:3.0:1782756270.736050:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782756270.736057:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa19971a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce111 expref: 54 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.736122:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168ca00, rc 0) 00000100:00100000:3.0:1782756270.736213:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+53:11453:x1869355210054656:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 570us (884us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1782756270.736232:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 163 00000100:00100000:2.0:1782756270.738943:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756270.739146:0:11978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210054784 00000100:00100000:3.0:1782756270.739160:0:11978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210054784 00000100:00100000:3.0:1782756270.739268:0:11978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 164 00000100:00100000:3.0:1782756270.739279:0:11978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+53:11453:x1869355210054784:12345-192.168.204.25@tcp:34:lfs.0 00010000:00010000:3.0:1782756270.739379:0:11978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199728 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.739399:0:11978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199728 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.739414:0:11978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199728 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.739444:0:11978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa19972f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.739466:0:11978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa19972f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.739473:0:11978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa19972f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.739603:0:11978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199736 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.739619:0:11978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199736 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.739627:0:11978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199736 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782756270.739693:0:11978:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199736 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.739708:0:11978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199728 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.739715:0:11978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199728 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.739723:0:11978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199728 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.739730:0:11978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168c400 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756270.739735:0:11978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199728 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.739744:0:11978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199728 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.739759:0:11978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:3.0:1782756270.739762:0:11978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756270.739769:0:11978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199728 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.739776:0:11978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199728 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.739795:0:11978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa19972f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.739801:0:11978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa19972f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.739814:0:11978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa19972f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.739820:0:11978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168cc00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756270.739823:0:11978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa19972f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.739830:0:11978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa19972f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.739838:0:11978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d3c49e15900) 00010000:00010000:3.0:1782756270.739840:0:11978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756270.739844:0:11978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa19972f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.739850:0:11978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa19972f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.739868:0:11978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199736 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.739874:0:11978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199736 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.739880:0:11978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199736 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.739885:0:11978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168d600 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756270.739888:0:11978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199736 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.739904:0:11978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199736 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.739912:0:11978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212d00) 00010000:00010000:3.0:1782756270.739914:0:11978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756270.739917:0:11978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199736 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.739923:0:11978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199736 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756270.740032:0:11978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+53:11453:x1869355210054784:12345-192.168.204.25@tcp:34:lfs.0 Request processed in 753us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756270.740041:0:11978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 164 00000100:00100000:0.0:1782756270.742737:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756270.742858:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210055040 00000100:00100000:3.0:1782756270.742870:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210055040 00000100:00100000:3.0:1782756270.742946:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 46 00000100:00100000:3.0:1782756270.742958:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+53:11453:x1869355210055040:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:3.0:1782756270.743552:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+54:11453:x1869355210055040:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 586us (832us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1782756270.743569:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 46 00000100:00100000:0.0:1782756270.776562:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756270.776686:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210055296 00000100:00100000:2.0:1782756270.776699:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210055296 00000100:00100000:2.0:1782756270.777039:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 165 00000100:00100000:2.0:1782756270.777053:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+54:11457:x1869355210055296:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1782756270.777149:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756270.777176:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19973d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce118 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.777519:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199744 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.777533:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199744 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.777545:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199744 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.777557:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19974b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.777562:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19974b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.777581:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19974b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.777718:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa199752 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.777724:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa199752 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.777729:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa199752 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756270.777736:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1782756270.777848:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199744 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.777853:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199744 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.777858:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199744 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.777862:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63c000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756270.777866:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199744 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.777871:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199744 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.777883:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:2.0:1782756270.777886:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756270.777898:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199744 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.777905:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199744 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.777922:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19974b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.777928:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19974b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.777935:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19974b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.777990:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756270.777994:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19974b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.778001:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19974b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.778010:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d3c58212700) 00010000:00010000:2.0:1782756270.778012:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756270.778015:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19974b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.778021:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19974b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.778072:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19973d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce118 expref: 57 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.778256:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa199752 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce118 expref: 56 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.778266:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212d00) 00010000:00010000:2.0:1782756270.778269:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782756270.778272:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63d600, rc 0) 00000100:00100000:2.0:1782756270.778358:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+56:11457:x1869355210055296:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1308us (1811us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1782756270.778368:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 165 00000100:00100000:0.0:1782756270.781283:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756270.781400:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210055424 00000100:00100000:2.0:1782756270.781412:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210055424 00000100:00100000:2.0:1782756270.781485:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 166 00000100:00100000:2.0:1782756270.781497:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+56:11457:x1869355210055424:12345-192.168.204.25@tcp:54:lfs.0 00010000:00010000:2.0:1782756270.781595:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa199760 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.781617:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa199760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.781632:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa199760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.781665:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa199760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.781673:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa199760 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.781702:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa199760 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.781709:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63cc00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756270.781715:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa199760 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.781724:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa199760 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.781738:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212d00) 00010000:00010000:2.0:1782756270.781742:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782756270.781747:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa199760 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.781754:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa199760 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756270.781844:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+56:11457:x1869355210055424:12345-192.168.204.25@tcp:54:lfs.0 Request processed in 348us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756270.781858:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 166 00000100:00100000:0.0:1782756270.782500:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756270.782572:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210055552 00000100:00100000:3.0:1782756270.782580:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210055552 00000100:00100000:3.0:1782756270.783103:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13 00000100:00100000:3.0:1782756270.783203:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+56:2356:x1869355210055552:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782756270.783356:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756270.783396:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa199752 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce118 expref: 56 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.783429:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212d00) 00010000:00010000:3.0:1782756270.783434:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782756270.783541:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+55:2356:x1869355210055552:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 429us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756270.783549:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13 00000100:00100000:0.0:1782756270.784004:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756270.784863:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210055808 00000100:00100000:0.0:1782756270.784884:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210055808 00000100:00100000:0.0:1782756270.784943:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 47 00000100:00100000:0.0:1782756270.784954:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+55:11457:x1869355210055808:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:0.0:1782756270.785314:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+56:11457:x1869355210055808:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 361us (1309us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1782756270.785322:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 47 00000100:00100000:0.0:1782756270.912864:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756270.913043:0:11978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210056064 00000100:00100000:3.0:1782756270.913056:0:11978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210056064 00000100:00100000:3.0:1782756270.913178:0:11978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 167 00000100:00100000:3.0:1782756270.913190:0:11978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+56:11475:x1869355210056064:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1782756270.913225:0:11978:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756270.913256:0:11978:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199767 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce11f expref: -99 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.913654:0:11978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa19976e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.913674:0:11978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa19976e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.913688:0:11978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa19976e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782756270.913703:0:11978:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1782756270.913886:0:11978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199767 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce11f expref: 59 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.913913:0:11978:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa19976e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce11f expref: 58 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.913942:0:11978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212d00) 00010000:00010000:3.0:1782756270.913946:0:11978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1782756270.913951:0:11978:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168cc00, rc 0) 00000100:00100000:3.0:1782756270.914047:0:11978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+58:11475:x1869355210056064:12345-192.168.204.25@tcp:101:cat.0 Request processed in 859us (1197us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1782756270.914056:0:11978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 167 00000100:00100000:1.0:1782756270.942058:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756270.942208:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210056192 00000100:00100000:2.0:1782756270.942221:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210056192 00000100:00100000:2.0:1782756270.942301:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 168 00000100:00100000:2.0:1782756270.942314:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+58:11476:x1869355210056192:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1782756270.942349:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756270.942378:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19977c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce126 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.942556:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa199783 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.942574:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa199783 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.942590:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa199783 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756270.942680:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1782756270.942685:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782756270.942718:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa199783 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.942753:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19977c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce126 expref: 60 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.942779:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa199783 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce126 expref: 59 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.942790:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:2.0:1782756270.942794:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782756270.942799:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63d000, rc 0) 00000100:00100000:2.0:1782756270.942886:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+59:11476:x1869355210056192:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 575us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756270.942900:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 168 00000100:00100000:2.0:1782756270.947347:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756270.947436:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210056576 00000100:00100000:3.0:1782756270.947467:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210056576 00000100:00100000:3.0:1782756270.947540:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 48 00000100:00100000:3.0:1782756270.947553:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+59:11476:x1869355210056576:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:3.0:1782756270.947972:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+60:11476:x1869355210056576:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 420us (641us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1782756270.947980:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 48 00000100:00100000:0.0:1782756270.950718:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756270.950854:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210056704 00000100:00100000:2.0:1782756270.950884:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210056704 00000100:00100000:2.0:1782756270.951048:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14 00000100:00100000:2.0:1782756270.951060:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c501d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+60:11476:x1869355210056704:12345-192.168.204.25@tcp:103:lfs.0 00010000:00010000:2.0:1782756270.951111:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1782756270.951154:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199713 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce10a expref: 60 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.951185:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa19976e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce11f expref: 59 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.951636:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa19961e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce0cb expref: 58 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756270.951654:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212d00) 00010000:00010000:2.0:1782756270.951666:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756270.951752:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c501d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+57:11476:x1869355210056704:12345-192.168.204.25@tcp:103:lfs.0 Request processed in 693us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756270.951762:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14 00000100:00100000:2.0:1782756270.957717:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756270.961373:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210056832 00000100:00100000:3.0:1782756270.961395:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210056832 00000100:00100000:3.0:1782756270.961529:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 169 00000100:00100000:3.0:1782756270.961554:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+57:11476:x1869355210056832:12345-192.168.204.25@tcp:58:lfs.0 00010000:00010000:3.0:1782756270.961731:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa19978a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.961753:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa19978a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756270.961768:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa19978a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782756270.962069:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1782756270.962531:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+57:11476:x1869355210056832:12345-192.168.204.25@tcp:58:lfs.0 Request processed in 988us (4825us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756270.962552:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 169 00000100:00100000:3.0:1782756270.990790:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756270.991219:0:11978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210056960 00000100:00100000:1.0:1782756270.991233:0:11978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210056960 00000100:00100000:1.0:1782756270.991323:0:11978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 170 00000100:00100000:1.0:1782756270.991336:0:11978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+57:11478:x1869355210056960:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1782756270.991366:0:11978:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756270.991393:0:11978:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa199791 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce12d expref: -99 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.991488:0:11978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199798 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.991506:0:11978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199798 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.991524:0:11978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199798 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.991553:0:11978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19979f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.991569:0:11978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19979f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.991577:0:11978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19979f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.991721:0:11978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa1997a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.991731:0:11978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa1997a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.991739:0:11978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa1997a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756270.991785:0:11978:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1782756270.991790:0:11978:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782756270.991811:0:11978:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa1997a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.991825:0:11978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa1997a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.991835:0:11978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199798 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.991842:0:11978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199798 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.991849:0:11978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199798 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.991856:0:11978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5800 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756270.991861:0:11978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199798 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.991869:0:11978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199798 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.991891:0:11978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:1.0:1782756270.991895:0:11978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756270.991901:0:11978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199798 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.991909:0:11978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199798 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.991925:0:11978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19979f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.991932:0:11978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19979f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.991939:0:11978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19979f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.991945:0:11978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5600 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756270.991949:0:11978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19979f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.991954:0:11978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19979f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.991962:0:11978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d3c4ef38400) 00010000:00010000:1.0:1782756270.991964:0:11978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756270.991967:0:11978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19979f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.991974:0:11978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa19979f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.993846:0:11978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa199791 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce12d expref: 59 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.993866:0:11978:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa1997a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce12d expref: 58 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756270.993875:0:11978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c49e15900) 00010000:00010000:1.0:1782756270.993878:0:11978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782756270.993882:0:11978:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef4600, rc 0) 00000100:00100000:1.0:1782756270.993994:0:11978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+58:11478:x1869355210056960:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2650us (3209us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756270.994007:0:11978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 170 00010000:00010000:1.0:1782756271.566113:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782756271.621636:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967454 is committed 00000020:00080000:1.0:1782756271.621668:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d3c78ef9b40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1782756271.621675:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d3c46769300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d3c78ef9a80 00000020:00080000:1.0:1782756271.621678:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d3c500a4b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d3c76d9c000 00000004:00080000:1.0:1782756271.621726:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000001:00080000:1.0:1782756271.621772:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000020:00080000:1.0:1782756271.621809:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1782756271.622169:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1782756271.622318:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76d79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222632320:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782756271.622541:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756271.623042:0:10416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222632320 00000100:00100000:2.0:1782756271.623053:0:10416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222632320 00000100:00100000:2.0:1782756271.623255:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782756271.623267:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222632320:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782756271.623305:0:10416:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1782756271.623351:0:10416:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a42b3ac, atime: 0x6a42b3ad, ctime: 0x6a42b3ac, blocks: 0xb 00010000:00010000:2.0:1782756271.623361:0:10416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007a620cf/0x5e4fb0a8aa1997ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756271.623510:0:10416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=312s v=(0 0) 00010000:00010000:2.0:1782756271.623517:0:10416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756271.623526:0:10416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007a620cf/0x5e4fb0a8aa1997ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756271.623544:0:10416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007a620cf/0x5e4fb0a8aa1997ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756271.623556:0:10416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007a620cf/0x5e4fb0a8aa1997ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756271.623564:0:10416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007a620cf/0x5e4fb0a8aa1997ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756271.623591:0:10416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782756271.624096:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782756271.624104:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007a620cf/0x5e4fb0a8aa1997ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.624132:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d200 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:1.0:1782756271.624138:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007a620cf/0x5e4fb0a8aa1997ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.624149:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007a620cf/0x5e4fb0a8aa1997ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.624171:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007a620cf/0x5e4fb0a8aa1997ad lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.624178:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007a620cf/0x5e4fb0a8aa1997ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.624201:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756271.624203:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756271.624205:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782756271.624673:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3316:x1869355222632320:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1402us (2126us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1782756271.624685:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782756271.626274:0:3316:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1782756271.626286:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00080000:0.0:1782756271.626308:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782756271.626316:0:3316:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9d3c76d79c00 x1869355222632320/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1782756287 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1782756271.626332:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d3c76d79c00/2, rc 0, transno 4294967307 00000100:00100000:1.0:1782756271.626338:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76d79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222632320:0@lo:6:osp-syn-1-0.0 00000040:00080000:2.0:1782756271.711335:0:12361:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782756271.711352:0:12361:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782756271.711435:0:12361:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1782756271.711444:0:12361:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1782756271.820334:0:11537:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782756271.820351:0:11537:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782756271.820734:0:11537:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1782756271.820743:0:11537:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782756271.821701:0:11537:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fb9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11537:1869355222632448:192.168.204.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782756271.822559:0:11537:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78ef9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782756271.824799:0:11537:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fb9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11537:1869355222632448:192.168.204.25@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782756271.832655:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756271.833050:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210057088 00000100:00100000:1.0:1782756271.833064:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210057088 00000100:00100000:1.0:1782756271.833347:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 171 00000100:00100000:1.0:1782756271.833370:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+16:11490:x1869355210057088:12345-192.168.204.25@tcp:53:lhsmtool_posix.0 00000100:00080000:2.0:1782756271.833420:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:1.0:1782756271.833420:0:6579:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782756271.833588:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+16:11490:x1869355210057088:12345-192.168.204.25@tcp:53:lhsmtool_posix.0 Request processed in 222us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756271.833600:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 171 00000100:00100000:2.0:1782756271.840392:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756271.844279:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210057216 00000100:00100000:0.0:1782756271.844295:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210057216 00000100:00100000:0.0:1782756271.844362:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 172 00000100:00100000:0.0:1782756271.844374:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+16:11490:x1869355210057216:12345-192.168.204.25@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1782756271.844466:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa1997b4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.844484:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa1997b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.844498:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa1997b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.844539:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1997bb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.844555:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1997bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.844562:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1997bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.844592:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1997c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.844600:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1997c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.844607:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1997c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782756271.844647:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1782756271.844652:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782756271.844666:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1997c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.844678:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa1997b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.844685:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa1997b4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.844693:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa1997b4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.844698:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81a200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756271.844703:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa1997b4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.844716:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa1997b4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.844729:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3c54288100) 00010000:00010000:0.0:1782756271.844733:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756271.844738:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa1997b4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.844744:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa1997b4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.844755:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1997bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.844761:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1997bb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.844766:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1997bb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.844771:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81aa00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756271.844774:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1997bb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.844779:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1997bb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.844785:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9d3c54288f00) 00010000:00010000:0.0:1782756271.844788:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756271.844791:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1997bb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.844806:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1997bb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.844822:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1997c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.844828:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1997c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.844833:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1997c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.844838:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81be00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756271.844842:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1997c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.844847:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1997c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.844855:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c49e15900) 00010000:00010000:0.0:1782756271.844858:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756271.844862:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1997c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.844868:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1997c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756271.844961:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+16:11490:x1869355210057216:12345-192.168.204.25@tcp:34:lhsmtool_posix.0 Request processed in 590us (4579us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756271.844970:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 172 00000100:00100000:2.0:1782756271.849384:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756271.849645:0:11978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210057472 00000100:00100000:1.0:1782756271.849664:0:11978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210057472 00000100:00100000:1.0:1782756271.849769:0:11978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 173 00000100:00100000:1.0:1782756271.849796:0:11978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+16:11490:x1869355210057472:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782756271.849830:0:11978:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756271.849865:0:11978:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1997c9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce134 expref: -99 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.850013:0:11978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1997d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.850033:0:11978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1997d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.850050:0:11978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1997d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756271.850065:0:11978:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1782756271.850435:0:11978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1997d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.850444:0:11978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1997d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.850468:0:11978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1997d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.850474:0:11978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5600 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756271.850480:0:11978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1997d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.850489:0:11978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1997d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.850504:0:11978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c49e15900) 00010000:00010000:1.0:1782756271.850508:0:11978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782756271.850512:0:11978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1997d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.850520:0:11978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1997d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.850583:0:11978:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1997c9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce134 expref: 18 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.850597:0:11978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3c54288100) 00010000:00010000:1.0:1782756271.850599:0:11978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782756271.850603:0:11978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1997c9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce134 expref: 18 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.850615:0:11978:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef4800, rc 0) 00000100:00100000:1.0:1782756271.850704:0:11978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+17:11490:x1869355210057472:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 921us (1334us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1782756271.850723:0:11978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 173 00000100:00100000:3.0:1782756271.861135:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756271.861372:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210057600 00000100:00100000:3.0:1782756271.861384:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210057600 00000100:00100000:3.0:1782756271.861580:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 174 00000100:00100000:3.0:1782756271.861594:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+17:11490:x1869355210057600:12345-192.168.204.25@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782756271.861637:0:5803:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782756271.861750:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+17:11490:x1869355210057600:12345-192.168.204.25@tcp:53:lhsmtool_posix.0 Request processed in 157us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756271.861760:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 174 00000100:00100000:3.0:1782756271.870890:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756271.871170:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210057856 00000100:00100000:0.0:1782756271.871181:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210057856 00000100:00100000:0.0:1782756271.871244:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 175 00000100:00100000:0.0:1782756271.871257:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+17:11490:x1869355210057856:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782756271.871286:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756271.871290:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782756271.871325:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa199783 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce126 expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.871350:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:0.0:1782756271.871357:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782756271.871378:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1997de lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce13b expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782756271.873202:0:5805:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1782756271.873609:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1997e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.873627:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1997e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.873640:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1997e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.873713:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1997de lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce13b expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.873731:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1997e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce13b expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.873753:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d3c54288f00) 00010000:00010000:0.0:1782756271.873757:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782756271.873760:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81aa00, rc 0) 00000100:00100000:0.0:1782756271.873856:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+18:11490:x1869355210057856:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 2601us (2979us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1782756271.873864:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 175 00000100:00100000:2.0:1782756271.883702:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756271.883791:0:11978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210058112 00000100:00100000:1.0:1782756271.883802:0:11978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210058112 00000100:00100000:1.0:1782756271.883879:0:11978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 176 00000100:00100000:1.0:1782756271.883890:0:11978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+18:11490:x1869355210058112:12345-192.168.204.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782756271.883952:0:11978:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756271.883979:0:11978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa1997e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce13b expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.884000:0:11978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d3c54288f00) 00010000:00010000:1.0:1782756271.884012:0:11978:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782756271.884035:0:11978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1997f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.884061:0:11978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1997f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.884100:0:11978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1997f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.884163:0:11978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1997fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xe016a025 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.884172:0:11978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1997fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe016a025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.884180:0:11978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1997fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe016a025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.884581:0:11978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1997f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.884590:0:11978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1997f3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.884597:0:11978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1997f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.884604:0:11978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4800 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756271.884609:0:11978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1997f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.884617:0:11978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1997f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.884627:0:11978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:1.0:1782756271.884630:0:11978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756271.884634:0:11978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1997f3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.884641:0:11978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa1997f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.884650:0:11978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1997fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe016a025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.884656:0:11978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1997fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe016a025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.884663:0:11978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1997fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe016a025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.884674:0:11978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5600 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756271.884677:0:11978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1997fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe016a025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.884683:0:11978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1997fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe016a025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.884690:0:11978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xe016a025 (ffff9d3c4ef38400) 00010000:00010000:1.0:1782756271.884693:0:11978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756271.884695:0:11978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1997fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe016a025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.884701:0:11978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5600/0x5e4fb0a8aa1997fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe016a025 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756271.884794:0:11978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+17:11490:x1869355210058112:12345-192.168.204.25@tcp:36:lhsmtool_posix.0 Request processed in 904us (1099us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782756271.884802:0:11978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 176 00000100:00100000:1.0:1782756271.889348:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756271.890691:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210058240 00000100:00100000:3.0:1782756271.890711:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210058240 00000100:00100000:3.0:1782756271.890792:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 177 00000100:00100000:3.0:1782756271.890805:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+17:11490:x1869355210058240:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782756271.890834:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756271.890869:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199801 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce142 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756271.890919:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199808 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756271.890953:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199808 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756271.890968:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199808 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756271.891142:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199801 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce142 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756271.891178:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199808 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce142 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756271.891190:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d3c49e15200) 00010000:00010000:3.0:1782756271.891193:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782756271.891197:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168c400, rc 0) 00000100:00100000:3.0:1782756271.891300:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+18:11490:x1869355210058240:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 497us (1960us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756271.891309:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 177 00000100:00100000:2.0:1782756271.895657:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756271.895723:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210058496 00000100:00100000:0.0:1782756271.895739:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210058496 00000100:00100000:0.0:1782756271.895823:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 178 00000100:00100000:0.0:1782756271.895836:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+18:11490:x1869355210058496:12345-192.168.204.25@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782756271.895964:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa19980f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.896398:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa19980f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.896410:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa19980f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782756271.896750:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1782756271.896761:0:5805:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 313131685354ns, next at 314131682919ns, rc = 0 00000004:00010000:0.0:1782756271.896851:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006fe037d2 reply state 000000003e105950 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa19980f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756271.896859:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782756271.897186:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+20:11490:x1869355210058496:12345-192.168.204.25@tcp:36:lhsmtool_posix.0 Request processed in 1348us (1540us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1782756271.897212:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 178 00000100:00100000:3.0:1782756271.901675:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756271.902603:0:11978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210058624 00000100:00100000:1.0:1782756271.902620:0:11978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210058624 00000100:00100000:3.0:1782756271.902769:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 179 00000100:00100000:3.0:1782756271.902786:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+20:11490:x1869355210058624:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782756271.902794:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa19980f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756271.902808:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa19980f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756271.902817:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa19980f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756271.902821:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756271.902828:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81be00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756271.902834:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa19980f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756271.902843:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199816 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce149 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756271.902845:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa19980f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756271.902874:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d3c49e15200) 00010000:00010000:2.0:1782756271.902878:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782756271.902885:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa19980f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756271.902892:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa19980f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756271.902921:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199816 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce149 expref: 20 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756271.902953:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199816 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce149 expref: 20 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756271.902972:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d3c49e15200) 00010000:00010000:3.0:1782756271.902975:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782756271.902978:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168ca00, rc 0) 00000100:00100000:3.0:1782756271.903064:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+20:11490:x1869355210058624:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 281us (1404us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756271.903072:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 179 00000100:00100000:3.0:1782756271.908828:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756271.908971:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210058752 00000100:00100000:0.0:1782756271.908983:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210058752 00000100:00100000:0.0:1782756271.909541:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 52 00000100:00100000:0.0:1782756271.909556:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43614e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+6:2356:x1869355210058752:12345-192.168.204.25@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1782756271.910373:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43614e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+7:2356:x1869355210058752:12345-192.168.204.25@tcp:2:lhsmtool_posix.0 Request processed in 817us (1551us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1782756271.910382:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 52 00000100:00080000:2.0:1782756271.910632:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782756271.914805:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756271.915023:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210059008 00000100:00100000:3.0:1782756271.915036:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210059008 00000100:00100000:3.0:1782756271.915175:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 49 00000100:00100000:3.0:1782756271.915188:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+20:11490:x1869355210059008:12345-192.168.204.25@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782756271.915754:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+21:11490:x1869355210059008:12345-192.168.204.25@tcp:35:lhsmtool_posix.0 Request processed in 367us (762us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1782756271.915769:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 49 00000100:00100000:0.0:1782756271.920983:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756271.921251:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210059264 00000100:00100000:2.0:1782756271.921266:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210059264 00000100:00100000:2.0:1782756271.921468:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 180 00000100:00100000:2.0:1782756271.921482:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+21:11490:x1869355210059264:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782756271.921764:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+21:11490:x1869355210059264:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 Request processed in 284us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756271.921793:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 180 00000100:00100000:2.0:1782756271.928406:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756271.928886:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210059392 00000100:00100000:1.0:1782756271.928902:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210059392 00000100:00100000:1.0:1782756271.929047:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 181 00000100:00100000:1.0:1782756271.929061:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+21:11490:x1869355210059392:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782756271.929130:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756271.929159:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa19981d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce150 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.929286:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa199824 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.929304:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa199824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.929318:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa199824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756271.929369:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782756271.929395:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa199824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.929439:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa19981d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce150 expref: 23 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.929475:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa199824 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce150 expref: 22 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.929486:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d3c49e15200) 00010000:00010000:1.0:1782756271.929489:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1782756271.929494:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef4800, rc 0) 00000100:00100000:1.0:1782756271.929592:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+22:11490:x1869355210059392:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 534us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756271.929601:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 181 00000100:00100000:0.0:1782756271.935556:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756271.936137:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210059520 00000100:00100000:1.0:1782756271.936152:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210059520 00000100:00100000:1.0:1782756271.936283:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 53 00000100:00100000:1.0:1782756271.936315:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+7:2358:x1869355210059520:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782756271.936342:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756271.936374:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fe33af4/0x5e4fb0a8aa19982b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce157 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782756271.936415:0:6605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a42b3af, blocks: 0x1 00010000:00010000:1.0:1782756271.936448:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=313s v=(0 0) 00010000:00010000:1.0:1782756271.936453:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756271.936681:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fe33af4/0x5e4fb0a8aa19982b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce157 expref: 8 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.936712:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004fe33af4/0x5e4fb0a8aa19982b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce157 expref: 8 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756271.936729:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef5600, rc 0) 00000100:00100000:1.0:1782756271.936815:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+8:2358:x1869355210059520:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 503us (1272us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756271.936823:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 53 00000100:00100000:0.0:1782756271.942258:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756271.942597:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210059776 00000100:00100000:3.0:1782756271.942613:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210059776 00000100:00100000:3.0:1782756271.942702:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 182 00000100:00100000:3.0:1782756271.942716:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+22:11490:x1869355210059776:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1782756271.942862:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+22:11490:x1869355210059776:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 Request processed in 149us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756271.942872:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 182 00000100:00100000:3.0:1782756271.947704:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756271.947892:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210059904 00000100:00100000:0.0:1782756271.947905:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210059904 00000100:00100000:0.0:1782756271.947991:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 54 00000100:00100000:0.0:1782756271.948005:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7ff36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+8:11490:x1869355210059904:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782756271.948032:0:6603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756271.948058:0:6603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa199832 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce15e expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.948165:0:6603:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004fe33af4/0x5e4fb0a8aa19982b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce157 expref: 9 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.948177:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782756271.948182:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782756271.948189:0:6603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa199832 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce15e expref: 9 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.948243:0:6603:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004fe33af4/0x5e4fb0a8aa19982b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce157 expref: 9 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756271.948260:0:6603:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004fe33af4/0x5e4fb0a8aa19982b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce157 expref: 9 pid: 6605 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756271.948277:0:6603:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6603:1869355222632576:192.168.204.25@tcp:104: 00000100:00100000:0.0:1782756271.948406:0:6603:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78ef9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782756271.952178:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756271.953392:0:8367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210060032 00000100:00100000:1.0:1782756271.953408:0:8367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210060032 00010000:00010000:1.0:1782756271.953630:0:8367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004fe33af4/0x5e4fb0a8aa19982b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce157 expref: 10 pid: 6605 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756271.953772:0:6603:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6603:1869355222632576:192.168.204.25@tcp:104: 00000100:00100000:2.0:1782756271.953821:0:8367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 69 00000100:00100000:2.0:1782756271.953836:0:8367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26487635-60cb-4aee-af8e-396654f6c3d8+10:2356:x1869355210060032:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782756271.953858:0:8367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756271.953889:0:8367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004fe33af4/0x5e4fb0a8aa19982b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce157 expref: 10 pid: 6605 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756271.953906:0:8367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004fe33af4/0x5e4fb0a8aa19982b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce157 expref: 10 pid: 6605 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756271.953939:0:8367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fe33af4/0x5e4fb0a8aa19982b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce157 expref: 10 pid: 6605 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756271.953964:0:8367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756271.954036:0:8367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756271.954048:0:8367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa199832 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce15e expref: 9 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756271.954061:0:8367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa199832 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce15e expref: 9 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756271.954163:0:6603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa199832 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce15e expref: 9 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756271.954178:0:6603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81aa00, rc 0) 00010000:00010000:2.0:1782756271.954330:0:8367:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa199832 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce15e expref: 9 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756271.954373:0:8367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c770fd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8367:1869355222632704:192.168.204.25@tcp:105: 00000100:00100000:3.0:1782756271.954582:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7ff36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+9:11490:x1869355210059904:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 6578us (6896us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756271.954582:0:8367:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76d17480 going to sleep for 11 seconds 00000100:00100000:3.0:1782756271.954592:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 54 00000100:00100000:0.0:1782756271.961824:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756271.962735:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210060160 00000100:00100000:3.0:1782756271.962750:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210060160 00002000:00100000:3.0:1782756271.962828:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9d3c80fb9500 x1869355210060160/t0(0) o4->26487635-60cb-4aee-af8e-396654f6c3d8@192.168.204.25@tcp:452/0 lens 504/0 e 0 to 0 dl 1782756282 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782756271.962842:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3c80fb9500 with x1869355210060160 ext(0->8) 00002000:00010000:3.0:1782756271.962849:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d3c80fb9500 00000100:00100000:3.0:1782756271.962897:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5 00000100:00100000:3.0:1782756271.962908:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26487635-60cb-4aee-af8e-396654f6c3d8+9:2356:x1869355210060160:12345-192.168.204.25@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1782756271.964668:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26487635-60cb-4aee-af8e-396654f6c3d8+11:2356:x1869355210060160:12345-192.168.204.25@tcp:4:lhsmtool_posix.0 Request processed in 1747us (2845us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1782756271.964684:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5 00002000:00100000:3.0:1782756271.964699:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9d3c80fb9500 x1869355210060160/t4294967314(0) o4->26487635-60cb-4aee-af8e-396654f6c3d8@192.168.204.25@tcp:452/0 lens 504/448 e 0 to 0 dl 1782756282 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782756271.964711:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3c80fb9500 with x1869355210060160 ext(0->8) 00002000:00010000:3.0:1782756271.964718:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d3c80fb9500 00000100:00100000:2.0:1782756271.966565:0:8367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c770fd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8367:1869355222632704:192.168.204.25@tcp:105: 00010000:00010000:2.0:1782756271.966604:0:8367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756271.966683:0:8367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26487635-60cb-4aee-af8e-396654f6c3d8+10:2356:x1869355210060032:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 12850us (14517us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756271.966696:0:8367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 69 00000100:00100000:0.0:1782756271.984262:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756271.988309:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210060288 00000100:00100000:2.0:1782756271.988336:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210060288 00000100:00100000:2.0:1782756271.988449:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 183 00000100:00100000:2.0:1782756271.988463:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+22:11490:x1869355210060288:12345-192.168.204.25@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1782756272.049668:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+22:11490:x1869355210060288:12345-192.168.204.25@tcp:44:lhsmtool_posix.0 Request processed in 61191us (65406us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756272.049686:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 183 00000001:00080000:3.0:1782756272.050041:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:3.0:1782756272.050050:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:3.0:1782756272.050125:0:5825:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:3.0:1782756272.050149:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:0.0:1782756272.050383:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1782756272.050401:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1782756272.050593:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c770fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222632832:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1782756272.050668:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756272.052354:0:10416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222632832 00000100:00100000:2.0:1782756272.052374:0:10416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222632832 00000100:00100000:3.0:1782756272.052497:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756272.052559:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210060416 00000100:00100000:1.0:1782756272.052564:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210060416 00000100:00100000:1.0:1782756272.052627:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 55 00000100:00100000:1.0:1782756272.052643:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7ff35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+10:2358:x1869355210060416:12345-192.168.204.25@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1782756272.053117:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782756272.053129:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7ff34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222632832:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1782756272.053364:0:10416:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1782756272.053368:0:10416:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1782756271 00002000:00010000:2.0:1782756272.053371:0:10416:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1782756272.053374:0:10416:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1782756271 -> 1782756271 00002000:00010000:2.0:1782756272.053376:0:10416:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1782756272.053454:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7ff34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3317:x1869355222632832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 328us (2785us total) trans 4294967315 rc 0/0 00000100:00080000:0.0:1782756272.053611:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782756272.053706:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000004:00080000:3.0:1782756272.053762:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d3c770fd500/2, rc 0, transno 4294967315 00000100:00100000:3.0:1782756272.053771:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c770fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222632832:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1782756272.077443:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782756272.077485:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7ff34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222632960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782756272.077592:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756272.077803:0:8071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222632960 00000100:00100000:3.0:1782756272.077814:0:8071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222632960 00000100:00100000:3.0:1782756272.077878:0:8071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782756272.077889:0:8071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ed8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1869355222632960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782756272.077919:0:8071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782756272.077990:0:8071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ed8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1869355222632960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756272.077999:0:8071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782756272.078063:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7ff34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222632960:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1782756272.097427:0:6627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:0.0:1782756272.097454:0:6627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:0.0:1782756272.097472:0:6627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:3.0:1782756272.097744:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7ff35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+7:2358:x1869355210060416:12345-192.168.204.25@tcp:16:lhsmtool_posix.0 Request processed in 45096us (45245us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756272.097759:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 55 00000100:00100000:0.0:1782756272.100636:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756272.100759:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210060672 00000100:00100000:1.0:1782756272.100772:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210060672 00000100:00100000:1.0:1782756272.100844:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 184 00000100:00100000:1.0:1782756272.100856:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+18:11490:x1869355210060672:12345-192.168.204.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782756272.100934:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756272.101031:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa199824 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce150 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756272.101057:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d3c49e15200) 00010000:00010000:1.0:1782756272.101063:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782756272.101247:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199839 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756272.101265:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199839 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756272.101275:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199839 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782756272.101706:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000041620286 reply state 00000000bdbdfbfe transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199839 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756272.101718:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782756272.101866:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+19:11490:x1869355210060672:12345-192.168.204.25@tcp:36:lhsmtool_posix.0 Request processed in 1010us (1243us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1782756272.101875:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 184 00000100:00100000:0.0:1782756272.104044:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756272.104194:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210060800 00000100:00100000:1.0:1782756272.104207:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210060800 00000100:00100000:1.0:1782756272.104280:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 57 00000100:00100000:1.0:1782756272.104291:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+7:2356:x1869355210060800:12345-192.168.204.25@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1782756272.104700:0:6603:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1782756272.104704:0:6603:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1782756271 -> 1782756270 00002000:00010000:1.0:1782756272.104706:0:6603:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1782756269 00002000:00010000:1.0:1782756272.104709:0:6603:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1782756271 -> 1782756270 00002000:00010000:1.0:1782756272.104711:0:6603:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1782756272.104909:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+8:2356:x1869355210060800:12345-192.168.204.25@tcp:2:lhsmtool_posix.0 Request processed in 618us (879us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1782756272.104919:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 57 00010000:00010000:2.0:1782756272.107088:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199839 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.107126:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199839 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.107135:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199839 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.107142:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5800 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756272.107148:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199839 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.107156:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199839 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.107178:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d3c49e15200) 00010000:00010000:2.0:1782756272.107182:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756272.107188:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199839 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.107194:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199839 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756272.113201:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756272.113286:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210061056 00000100:00100000:3.0:1782756272.113301:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210061056 00000100:00100000:3.0:1782756272.113385:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 185 00000100:00100000:3.0:1782756272.113409:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+18:11490:x1869355210061056:12345-192.168.204.25@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1782756272.113518:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199840 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756272.113558:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199808 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce142 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756272.113570:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199840 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756272.113617:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199808 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce142 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756272.113634:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199808 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce142 expref: 18 pid: 5804 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756272.113653:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7ff34700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1869355222633088:192.168.204.25@tcp:104: 00000100:00100000:3.0:1782756272.113768:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76fc83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782756272.117690:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7ff34700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1869355222633088:192.168.204.25@tcp:104: 00010000:00010000:3.0:1782756272.117733:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199840 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756272.119545:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756272.119643:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210061184 00000100:00100000:2.0:1782756272.119655:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210061184 00010000:00010000:2.0:1782756272.119711:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199808 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce142 expref: 19 pid: 5804 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756272.119786:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 70 00000100:00100000:2.0:1782756272.119799:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7ff34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+19:2355:x1869355210061184:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782756272.119820:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756272.119829:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199808 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce142 expref: 19 pid: 5804 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.119844:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199808 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce142 expref: 19 pid: 5804 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.119871:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199808 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce142 expref: 19 pid: 5804 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.119891:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d3c49e15200) 00010000:00010000:2.0:1782756272.119897:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199840 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.119909:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199840 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.119917:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199840 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.119954:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756272.120048:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7ff34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+18:2355:x1869355210061184:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 251us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756272.120057:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 70 00010000:00010000:3.0:1782756272.120237:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199840 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756272.120246:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199840 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756272.120286:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199840 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756272.120306:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199840 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756272.120313:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199840 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756272.120320:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168d200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756272.120326:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199840 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756272.120335:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199840 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756272.120346:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d3c49e15200) 00010000:00010000:3.0:1782756272.120349:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1782756272.120353:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199840 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756272.120365:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199840 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756272.120565:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+17:11490:x1869355210061056:12345-192.168.204.25@tcp:55:lhsmtool_posix.0 Request processed in 7168us (7380us total) trans 0 rc -22/-22 00000100:00100000:3.0:1782756272.120575:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 185 00000100:00100000:3.0:1782756272.123571:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756272.125387:0:10416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210061312 00000100:00100000:2.0:1782756272.125425:0:10416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210061312 00000100:00100000:2.0:1782756272.125513:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 58 00000100:00100000:2.0:1782756272.125527:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7ff35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+8:2356:x1869355210061312:12345-192.168.204.25@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1782756272.125594:0:10416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199847 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.125623:0:10416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa199832 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce15e expref: 8 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.125633:0:10416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756272.125639:0:10416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782756272.125644:0:10416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199847 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.125706:0:10416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa199832 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce15e expref: 8 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.125723:0:10416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa199832 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce15e expref: 8 pid: 6603 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756272.125742:0:10416:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c770ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10416:1869355222633216:192.168.204.25@tcp:104: 00000100:00100000:2.0:1782756272.125868:0:10416:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76d17e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782756272.130275:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756272.130348:0:10416:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c770ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10416:1869355222633216:192.168.204.25@tcp:104: 00010000:00010000:1.0:1782756272.130384:0:10416:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199847 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756272.130392:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210061440 00000100:00100000:0.0:1782756272.130401:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210061440 00010000:00010000:0.0:1782756272.130566:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa199832 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce15e expref: 9 pid: 6603 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756272.130656:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 71 00000100:00100000:0.0:1782756272.130668:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+9:2356:x1869355210061440:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782756272.130705:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756272.130736:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa199832 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce15e expref: 9 pid: 6603 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756272.130751:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa199832 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce15e expref: 9 pid: 6603 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756272.130780:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb12fd33/0x5e4fb0a8aa199832 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce15e expref: 9 pid: 6603 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756272.130798:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782756272.130803:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782756272.130810:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199847 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756272.130821:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199847 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756272.130856:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782756272.130890:0:10416:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199847 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756272.130900:0:10416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199847 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756272.130926:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+8:2356:x1869355210061440:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 259us (668us total) trans 0 rc 0/0 00010000:00010000:1.0:1782756272.130930:0:10416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199847 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756272.130935:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 71 00010000:00010000:1.0:1782756272.130938:0:10416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199847 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756272.130963:0:10416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199847 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756272.131185:0:10416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d200 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:1.0:1782756272.131191:0:10416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199847 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756272.131202:0:10416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199847 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756272.131215:0:10416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199847 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756272.131222:0:10416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199847 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756272.131298:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7ff35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+7:2356:x1869355210061312:12345-192.168.204.25@tcp:1:lhsmtool_posix.0 Request processed in 5774us (7741us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756272.131308:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 58 00000100:00100000:2.0:1782756272.137624:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756272.138296:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210061696 00000100:00100000:3.0:1782756272.138311:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210061696 00000100:00100000:3.0:1782756272.138562:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 186 00000100:00100000:3.0:1782756272.138576:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+17:11490:x1869355210061696:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1782756272.138713:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa19984e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756272.138735:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa19984e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756272.138749:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa19984e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756272.139244:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199855 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756272.139261:0:6579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199816 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce149 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756272.139271:0:6579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199855 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756272.139318:0:6579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199816 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce149 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756272.139335:0:6579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199816 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce149 expref: 18 pid: 5804 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756272.139354:0:6579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7ff37b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6579:1869355222633344:192.168.204.25@tcp:104: 00000100:00100000:3.0:1782756272.139683:0:6579:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76fc83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782756272.143692:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756272.143815:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210061824 00000100:00100000:0.0:1782756272.143827:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210061824 00010000:00010000:0.0:1782756272.143878:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199816 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce149 expref: 19 pid: 5804 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756272.144070:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 72 00000100:00100000:0.0:1782756272.144124:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7ff34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+19:2356:x1869355210061824:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782756272.144146:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756272.144154:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199816 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce149 expref: 19 pid: 5804 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756272.144169:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199816 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce149 expref: 19 pid: 5804 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756272.144198:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d3c49e15200) 00010000:00010000:0.0:1782756272.144203:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199855 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756272.144215:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199855 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756272.144224:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199855 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756272.144245:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756272.144308:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7ff34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+19:2356:x1869355210061824:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 187us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756272.144315:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 72 00010000:00010000:2.0:1782756272.144413:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199816 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce149 expref: 18 pid: 5804 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756272.144454:0:6579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7ff37b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6579:1869355222633344:192.168.204.25@tcp:104: 00010000:00010000:2.0:1782756272.144484:0:6579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199855 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.144494:0:6579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199855 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.144502:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199855 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782756272.145034:0:6579:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1782756272.145345:0:6579:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1782756272.145847:0:6579:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1782756272.146151:0:6579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c770ff480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6579:1869355222633472:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1782756272.146239:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756272.146283:0:6579:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76d17780 going to sleep for 11 seconds 00000100:00100000:2.0:1782756272.149160:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222633472 00000100:00100000:2.0:1782756272.149179:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222633472 00000100:00100000:2.0:1782756272.149258:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782756272.149270:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6579:x1869355222633472:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1782756272.149440:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6579:x1869355222633472:12345-0@lo:1000:mdt00_003.0 Request processed in 172us (3201us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756272.149448:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782756272.149518:0:6579:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1782756272.149527:0:6579:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d3c770fd500, transno 4294967315 00000100:00100000:3.0:1782756272.149570:0:6579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c770ff480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6579:1869355222633472:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1782756272.150388:0:6579:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1782756272.150500:0:6579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7ff37480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6579:1869355222633600:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1782756272.150570:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756272.150600:0:6579:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76fc8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782756272.151283:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222633600 00000100:00100000:0.0:1782756272.151293:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222633600 00000100:00100000:0.0:1782756272.151357:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782756272.151368:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7ff37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6579:x1869355222633600:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782756272.151758:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7ff37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6579:x1869355222633600:12345-0@lo:1000:mdt00_003.0 Request processed in 391us (1186us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1782756272.151767:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782756272.152504:0:6579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7ff37480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6579:1869355222633600:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1782756272.153605:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199855 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.153619:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199855 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.153647:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199855 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.153654:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168cc00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756272.153660:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199855 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.153669:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199855 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.153689:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d3c49e15200) 00010000:00010000:2.0:1782756272.153693:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782756272.153700:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199855 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.153707:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199855 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.153746:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa19978a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.153752:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa19978a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.153757:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa19978a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.153762:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168d600 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756272.153765:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa19978a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.153780:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa19978a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.153848:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c49e15900) 00010000:00010000:2.0:1782756272.153851:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782756272.153854:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa19978a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.153860:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa19978a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.153891:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19985c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.153908:0:6579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa1997a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce12d expref: 21 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.153918:0:6579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19985c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.154246:0:6579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa1997a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce12d expref: 21 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.154267:0:6579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa1997a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce12d expref: 21 pid: 11978 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756272.154286:0:6579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78a30700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6579:1869355222633728:192.168.204.25@tcp:104: 00000100:00100000:2.0:1782756272.155408:0:6579:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76d17540 going to sleep for 11 seconds 00000100:00100000:2.0:1782756272.161626:0:6579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78a30700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6579:1869355222633728:192.168.204.25@tcp:104: 00010000:00010000:2.0:1782756272.161691:0:6579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19985c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756272.162828:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756272.162920:0:8367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210061952 00000100:00100000:2.0:1782756272.162930:0:8367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210061952 00010000:00010000:2.0:1782756272.163000:0:8367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa1997a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce12d expref: 22 pid: 11978 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756272.163050:0:8367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 73 00000100:00100000:2.0:1782756272.163063:0:8367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7ff37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26487635-60cb-4aee-af8e-396654f6c3d8+22:2356:x1869355210061952:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782756272.163113:0:8367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756272.163121:0:8367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa1997a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce12d expref: 22 pid: 11978 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.163137:0:8367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa1997a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce12d expref: 22 pid: 11978 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.163164:0:8367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa1997a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce12d expref: 22 pid: 11978 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.163184:0:8367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c49e15900) 00010000:00010000:2.0:1782756272.163190:0:8367:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19985c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.163202:0:8367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19985c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.163210:0:8367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19985c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.163267:0:8367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756272.163346:0:8367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7ff37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26487635-60cb-4aee-af8e-396654f6c3d8+21:2356:x1869355210061952:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 285us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756272.163355:0:8367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 73 00010000:00010000:0.0:1782756272.163401:0:6579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19985c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756272.163411:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19985c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756272.163426:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19985c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756272.163433:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19985c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756272.163440:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19985c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756272.163447:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63de00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756272.163462:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19985c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756272.163471:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19985c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756272.163482:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c49e15900) 00010000:00010000:0.0:1782756272.163485:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756272.163490:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19985c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756272.163497:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19985c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756272.163521:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa19984e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756272.163528:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa19984e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756272.163533:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa19984e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756272.163538:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168c200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756272.163541:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa19984e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756272.163546:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa19984e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756272.163555:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c49e15900) 00010000:00010000:0.0:1782756272.163557:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782756272.163560:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa19984e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756272.163566:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa19984e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756272.163878:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+20:11490:x1869355210061696:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 Request processed in 25304us (26270us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1782756272.163889:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 186 00000020:00080000:0.0:1782756272.163893:0:6579:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1782756272.164635:0:11537:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782756272.164643:0:11537:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782756272.167284:0:11537:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1782756272.167310:0:11537:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782756272.169649:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756272.169929:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210062208 00000100:00100000:1.0:1782756272.169948:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210062208 00000100:00100000:1.0:1782756272.170209:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 50 00000100:00100000:1.0:1782756272.170221:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4977bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+20:11490:x1869355210062208:12345-192.168.204.25@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1782756272.174920:0:5807:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1782756272.175415:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1782756272.175731:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa199863 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756272.175755:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa199863 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756272.175771:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa199863 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756272.175783:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa199863 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756272.175877:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa199863 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756272.175885:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa199863 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756272.176198:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782756272.176357:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4977bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+22:11490:x1869355210062208:12345-192.168.204.25@tcp:35:lhsmtool_posix.0 Request processed in 6132us (6715us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1782756272.176369:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 50 00000020:00080000:1.0:1782756272.176377:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1782756272.177933:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782756272.177949:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa199863 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.178256:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4800 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:2.0:1782756272.178262:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa199863 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.178276:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa199863 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.178297:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d3c540df100) 00010000:00010000:2.0:1782756272.178301:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782756272.178308:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa199863 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.178315:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4800/0x5e4fb0a8aa199863 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756272.178339:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756272.178342:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756272.178343:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756272.588502:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782756273.449600:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756273.449793:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210062336 00000100:00100000:1.0:1782756273.449808:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210062336 00000100:00100000:1.0:1782756273.449877:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 282 00000100:00100000:1.0:1782756273.449901:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2355:x1869355210062336:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1782756273.449996:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2355:x1869355210062336:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 98us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756273.450006:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 282 00000100:00100000:0.0:1782756273.452058:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756273.452242:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210062464 00000100:00100000:3.0:1782756273.452253:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210062464 00000100:00100000:3.0:1782756273.452332:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 121 00000100:00100000:3.0:1782756273.452343:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+22:2355:x1869355210062464:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756273.452457:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+22:2355:x1869355210062464:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 115us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756273.452464:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 121 00000100:00080000:2.0:1782756273.452775:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782756273.455069:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756273.455138:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756273.455176:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756273.455215:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210062848 00000100:00100000:0.0:1782756273.455226:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210062848 00000100:00100000:0.0:1782756273.455304:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 122 00000100:00100000:0.0:1782756273.455316:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2356:x1869355210062848:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756273.455409:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2356:x1869355210062848:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 95us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756273.455417:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 122 00000100:00080000:0.0:1782756273.455441:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782756273.455536:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210062720 00000100:00100000:1.0:1782756273.455542:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210062720 00000100:00080000:0.0:1782756273.455565:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782756273.455597:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210062592 00000100:00100000:1.0:1782756273.455602:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210062592 00000100:00100000:1.0:1782756273.455631:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 68 00000100:00100000:1.0:1782756273.455639:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+5:2356:x1869355210062720:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1782756273.455681:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+5:2356:x1869355210062720:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 43us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756273.455688:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 68 00000100:00100000:1.0:1782756273.455703:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 69 00000100:00100000:1.0:1782756273.455710:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+7:2356:x1869355210062592:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1782756273.455738:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+7:2356:x1869355210062592:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 29us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756273.455745:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 69 00000100:00080000:0.0:1782756273.457726:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1782756273.550144:0:12413:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782756273.550158:0:12413:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782756273.550220:0:12413:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1782756273.550226:0:12413:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1782756273.612354:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756273.613209:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869355222633984:0@lo:400:kworker.0 00000100:00100000:0.0:1782756273.613257:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222634240:0@lo:400:kworker.0 00000100:00100000:3.0:1782756273.615345:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0daec403-69b6-4c98-a0ea-f519ca0a480f:3315:1869355222633856:0@lo:400:kworker.0 00000100:00100000:2.0:1782756273.616142:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c77042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222634112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782756273.616143:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756273.616268:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222634240 00000100:00100000:0.0:1782756273.616277:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222634240 00000100:00100000:0.0:1782756273.616349:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1782756273.616361:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222634240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756273.616449:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222634240:12345-0@lo:400:kworker.0 Request processed in 89us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756273.616457:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:0.0:1782756273.616483:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782756273.616525:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222634240:0@lo:400:kworker.0 00000100:00100000:3.0:1782756273.617203:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756273.617246:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222634368:0@lo:400:kworker.0 00000100:00100000:3.0:1782756273.617281:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756273.617388:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222633856 00000100:00100000:3.0:1782756273.617403:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222633856 00000100:00100000:3.0:1782756273.617555:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1782756273.617565:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3315:x1869355222633856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782756273.617624:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3315:x1869355222633856:12345-0@lo:400:kworker.0 Request processed in 60us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756273.617631:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1782756273.617817:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0daec403-69b6-4c98-a0ea-f519ca0a480f:3315:1869355222633856:0@lo:400:kworker.0 00000100:00100000:3.0:1782756273.617878:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222634368 00000100:00100000:3.0:1782756273.617882:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222634368 00000100:00100000:3.0:1782756273.617945:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782756273.617952:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7ff35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1869355222634368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782756273.617995:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7ff35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1869355222634368:12345-0@lo:400:kworker.0 Request processed in 44us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756273.618001:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782756273.618141:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756273.618184:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869355222634496:0@lo:400:kworker.0 00000100:00100000:0.0:1782756273.618227:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756273.618265:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222633984 00000100:00100000:0.0:1782756273.618270:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222633984 00000100:00100000:0.0:1782756273.618300:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222634496 00000100:00100000:0.0:1782756273.618303:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222634496 00000100:00100000:0.0:1782756273.618348:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1782756273.618356:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869355222633984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756273.618405:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869355222633984:12345-0@lo:400:kworker.0 Request processed in 49us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756273.618413:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1782756273.618440:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1782756273.618449:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869355222634496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756273.618480:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869355222634496:12345-0@lo:400:kworker.0 Request processed in 34us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756273.618486:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1782756273.618487:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222634368:0@lo:400:kworker.0 00000100:00080000:0.0:1782756273.618518:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782756273.618545:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869355222634496:0@lo:400:kworker.0 00000100:00100000:0.0:1782756273.618561:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869355222633984:0@lo:400:kworker.0 00000100:00100000:2.0:1782756273.621130:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756273.621263:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222634624:0@lo:400:kworker.0 00000100:00100000:2.0:1782756273.621308:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756273.621430:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222634624 00000100:00100000:1.0:1782756273.621441:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222634624 00000100:00100000:1.0:1782756273.621545:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782756273.621557:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3317:x1869355222634624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756273.621632:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3317:x1869355222634624:12345-0@lo:400:kworker.0 Request processed in 77us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756273.621652:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1782756273.621727:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782756273.621783:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222634624:0@lo:400:kworker.0 00000100:00100000:3.0:1782756273.629259:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222634112 00000100:00100000:3.0:1782756273.629525:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222634112 00000100:00100000:3.0:1782756273.629631:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782756273.629645:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78a30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1869355222634112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782756273.629720:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782756273.629850:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78a30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1869355222634112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 206us (8725us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756273.629859:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1782756273.629999:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c77042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222634112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782756273.675233:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756273.678493:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210063104 00000100:00100000:3.0:1782756273.678518:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210063104 00000100:00100000:3.0:1782756273.678611:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 187 00000100:00100000:3.0:1782756273.678625:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+22:11508:x1869355210063104:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1782756273.678665:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756273.678695:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa19986a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce165 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.679131:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199871 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.679154:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199871 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.679168:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199871 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782756273.679184:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1782756273.683540:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa19986a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce165 expref: 25 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.683578:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199871 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce165 expref: 24 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.683590:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:3.0:1782756273.683593:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782756273.683597:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168d600, rc 0) 00000100:00100000:3.0:1782756273.683698:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+24:11508:x1869355210063104:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 5075us (8477us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1782756273.683709:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 187 00000100:00100000:3.0:1782756273.685921:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756273.686043:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210063232 00000100:00100000:1.0:1782756273.686058:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210063232 00000100:00100000:1.0:1782756273.686308:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 188 00000100:00100000:1.0:1782756273.686322:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7ff35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+24:11508:x1869355210063232:12345-192.168.204.25@tcp:34:lfs.0 00010000:00010000:1.0:1782756273.686441:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19987f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.686466:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19987f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.686480:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19987f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.686500:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199886 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.686509:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.686515:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.686920:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa19988d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.686931:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa19988d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.686952:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa19988d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782756273.687013:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa19988d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.687030:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19987f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.687037:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19987f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.687046:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19987f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.687053:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756273.687059:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19987f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.687068:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19987f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.687125:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:1.0:1782756273.687128:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756273.687135:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19987f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.687143:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa19987f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.687157:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.687170:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199886 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.687177:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199886 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.687182:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4400 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756273.687186:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199886 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.687193:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199886 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.687203:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d3c540dfc00) 00010000:00010000:1.0:1782756273.687266:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756273.687270:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199886 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.687276:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa199886 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.687295:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa19988d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.687302:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa19988d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.687307:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa19988d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.687311:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4e00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756273.687319:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa19988d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.687325:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa19988d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.687333:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c540df600) 00010000:00010000:1.0:1782756273.687335:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756273.687338:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa19988d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.687344:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa19988d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756273.687462:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7ff35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+24:11508:x1869355210063232:12345-192.168.204.25@tcp:34:lfs.0 Request processed in 1138us (1550us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756273.687472:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 188 00000100:00100000:1.0:1782756273.725171:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756273.725277:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210063488 00000100:00100000:2.0:1782756273.725292:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210063488 00000100:00100000:2.0:1782756273.725371:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 189 00000100:00100000:2.0:1782756273.725383:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+24:11511:x1869355210063488:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1782756273.725412:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756273.725439:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199894 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce16c expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.725539:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19989b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.725558:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19989b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.725571:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19989b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.725588:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1998a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.725596:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1998a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.725602:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1998a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.726036:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa1998a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.726045:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa1998a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.726053:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa1998a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756273.726066:0:6579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1782756273.726227:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19989b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.726237:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19989b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.726244:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19989b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.726251:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63de00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756273.726256:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19989b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.726264:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19989b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.726281:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:2.0:1782756273.726284:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756273.726290:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19989b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.726308:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa19989b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.726330:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1998a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.726337:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1998a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.726344:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1998a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.726350:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756273.726354:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1998a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.726362:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1998a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.726370:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d3c58212000) 00010000:00010000:2.0:1782756273.726373:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756273.726376:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1998a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.726382:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa1998a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.726435:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199894 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce16c expref: 27 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.726451:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa1998a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce16c expref: 26 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.726465:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212900) 00010000:00010000:2.0:1782756273.726468:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782756273.726471:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63cc00, rc 0) 00000100:00100000:2.0:1782756273.726562:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+26:11511:x1869355210063488:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1180us (1405us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1782756273.726571:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 189 00000100:00100000:2.0:1782756273.731461:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756273.734507:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210063616 00000100:00100000:3.0:1782756273.734528:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210063616 00000100:00100000:3.0:1782756273.734725:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 190 00000100:00100000:3.0:1782756273.734748:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76fd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+26:11511:x1869355210063616:12345-192.168.204.25@tcp:54:lfs.0 00010000:00010000:3.0:1782756273.734848:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa1998b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.734870:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa1998b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.734885:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa1998b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.734921:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa1998b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.734929:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa1998b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.734937:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa1998b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.734944:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168d200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756273.734949:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa1998b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.734957:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa1998b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.734972:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212900) 00010000:00010000:3.0:1782756273.734975:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782756273.734982:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa1998b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.735000:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa1998b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756273.735251:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76fd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+26:11511:x1869355210063616:12345-192.168.204.25@tcp:54:lfs.0 Request processed in 504us (3802us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756273.735261:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 190 00000100:00100000:2.0:1782756273.741022:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756273.741410:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210063872 00000100:00100000:0.0:1782756273.741425:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210063872 00000100:00100000:0.0:1782756273.741503:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 51 00000100:00100000:0.0:1782756273.741517:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c809f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+26:11511:x1869355210063872:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:0.0:1782756273.741823:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c809f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+27:11511:x1869355210063872:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 308us (815us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1782756273.741844:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 51 00000100:00100000:3.0:1782756273.776373:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756273.778583:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210064128 00000100:00100000:1.0:1782756273.778603:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210064128 00000100:00100000:1.0:1782756273.778688:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 191 00000100:00100000:1.0:1782756273.778700:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7ff36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+27:11037:x1869355210064128:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:1.0:1782756273.778733:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756273.778760:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa1998be lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce173 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.778890:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1998c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.778906:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa1998a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce16c expref: 28 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.778922:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1998c5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.778968:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa1998a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce16c expref: 28 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.778982:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa1998a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce16c expref: 28 pid: 6579 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756273.778999:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76f8d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869355222634752:192.168.204.25@tcp:104: 00000100:00100000:1.0:1782756273.779173:0:5805:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3b429800c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782756273.784695:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756273.784715:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76f8d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869355222634752:192.168.204.25@tcp:104: 00010000:00010000:2.0:1782756273.784752:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1998c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756273.784757:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210064256 00000100:00100000:3.0:1782756273.784766:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210064256 00010000:00010000:3.0:1782756273.784830:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa1998a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce16c expref: 29 pid: 6579 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756273.784873:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 74 00000100:00100000:3.0:1782756273.784884:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26487635-60cb-4aee-af8e-396654f6c3d8+29:2355:x1869355210064256:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782756273.784905:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756273.784913:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa1998a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce16c expref: 29 pid: 6579 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.784927:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa1998a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce16c expref: 29 pid: 6579 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.784970:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa1998a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce16c expref: 29 pid: 6579 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.784987:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212900) 00010000:00010000:3.0:1782756273.784992:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1998c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.785021:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1998c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.785030:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1998c5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.785065:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782756273.785182:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26487635-60cb-4aee-af8e-396654f6c3d8+28:2355:x1869355210064256:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 297us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756273.785191:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 74 00010000:00010000:2.0:1782756273.785452:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1998c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.785461:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1998c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756273.785487:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1782756273.785710:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4400/0x5e4fb0a8aa1998be lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce173 expref: 29 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.785728:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1998c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce173 expref: 28 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.785738:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212900) 00010000:00010000:2.0:1782756273.785749:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782756273.785753:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef5200, rc 0) 00000100:00100000:2.0:1782756273.785807:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7ff36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+28:11037:x1869355210064128:12345-192.168.204.25@tcp:101:bash.0 Request processed in 7109us (9450us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1782756273.785816:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 191 00000100:00100000:1.0:1782756273.787988:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756273.788040:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210064512 00000100:00100000:0.0:1782756273.788323:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210064512 00000100:00100000:0.0:1782756273.788379:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 192 00000100:00100000:0.0:1782756273.788389:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+28:11037:x1869355210064512:12345-192.168.204.25@tcp:36:bash.0 00010000:00010000:0.0:1782756273.789431:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa1998d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.789456:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa1998d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.789471:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa1998d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782756273.789556:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1782756273.790647:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000054bca008 reply state 00000000bc240d2a transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa1998d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756273.790663:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1782756273.790763:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1782756273.790929:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+32:11037:x1869355210064512:12345-192.168.204.25@tcp:36:bash.0 Request processed in 2536us (2945us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1782756273.790940:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 192 00000020:00080000:0.0:1782756273.790948:0:5803:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1782756273.798429:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa1998d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.798449:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa1998d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.798455:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa1998d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.798467:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81b000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756273.798472:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa1998d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.798479:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa1998d3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.798500:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212900) 00010000:00010000:3.0:1782756273.798503:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756273.798506:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa1998d3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.798532:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa1998d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756273.798810:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756273.798871:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210064640 00000100:00100000:3.0:1782756273.798882:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210064640 00000100:00100000:3.0:1782756273.798954:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 193 00000100:00100000:3.0:1782756273.798966:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c809f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+31:11037:x1869355210064640:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:3.0:1782756273.798997:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756273.799019:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa1998da lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce17a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.799146:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa1998da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce17a expref: 32 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.799287:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa1998da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce17a expref: 32 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.799312:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212900) 00010000:00010000:3.0:1782756273.799315:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782756273.799318:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168d200, rc 0) 00000100:00100000:3.0:1782756273.799388:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c809f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+32:11037:x1869355210064640:12345-192.168.204.25@tcp:101:bash.0 Request processed in 424us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756273.799396:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 193 00000100:00100000:1.0:1782756273.804737:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756273.804842:0:10416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210064768 00000100:00100000:0.0:1782756273.804854:0:10416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210064768 00000100:00100000:0.0:1782756273.804935:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 59 00000100:00100000:0.0:1782756273.804948:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+7:11037:x1869355210064768:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:0.0:1782756273.804973:0:10416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756273.805019:0:10416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7380b48/0x5e4fb0a8aa1998e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce181 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782756273.805053:0:10416:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a42b3ae, atime: 0x6a42b3ad, ctime: 0x6a42b3ae, blocks: 0xb 00010000:00010000:0.0:1782756273.805142:0:10416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=315s v=(0 0) 00010000:00010000:0.0:1782756273.805148:0:10416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782756273.805159:0:10416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7380b48/0x5e4fb0a8aa1998e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce181 expref: 8 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.805182:0:10416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d7380b48/0x5e4fb0a8aa1998e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce181 expref: 8 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.805198:0:10416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81a000, rc 0) 00000100:00100000:0.0:1782756273.805275:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+8:11037:x1869355210064768:12345-192.168.204.25@tcp:101:bash.0 Request processed in 330us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756273.805283:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 59 00000100:00100000:1.0:1782756273.808489:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756273.808561:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210064896 00000100:00100000:0.0:1782756273.808575:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210064896 00002000:00010000:0.0:1782756273.808637:0:6609:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1782756273.808644:0:6609:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3c78fc0380 with x1869355210064896 ext(0->18446744073709551615) 00002000:00010000:0.0:1782756273.808659:0:6609:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d3c78fc0380. 00000100:00100000:0.0:1782756273.808705:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6 00000100:00100000:0.0:1782756273.808717:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78fc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26487635-60cb-4aee-af8e-396654f6c3d8+8:2355:x1869355210064896:12345-192.168.204.25@tcp:10:bash.0 00002000:00010000:0.0:1782756273.809589:0:6609:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1782756273.809595:0:6609:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1782756270 -> 1782756273 00002000:00010000:0.0:1782756273.809598:0:6609:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1782756269 -> 1782756269 00002000:00010000:0.0:1782756273.809618:0:6609:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1782756270 -> 1782756273 00002000:00010000:0.0:1782756273.809620:0:6609:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1782756273.809710:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78fc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26487635-60cb-4aee-af8e-396654f6c3d8+9:2355:x1869355210064896:12345-192.168.204.25@tcp:10:bash.0 Request processed in 992us (1236us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1782756273.809721:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6 00002000:00010000:0.0:1782756273.809726:0:6609:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1782756273.809729:0:6609:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3c78fc0380 with x1869355210064896 ext(0->18446744073709551615) 00002000:00010000:0.0:1782756273.809735:0:6609:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d3c78fc0380. 00000100:00100000:2.0:1782756273.858628:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756273.859036:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210065024 00000100:00100000:1.0:1782756273.859050:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210065024 00000100:00100000:1.0:1782756273.859305:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 194 00000100:00100000:1.0:1782756273.859320:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+32:11525:x1869355210065024:12345-192.168.204.25@tcp:34:lfs.0 00010000:00010000:1.0:1782756273.859434:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1998e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.859457:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1998e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.859471:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1998e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.859515:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa1998ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.859524:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa1998ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.859531:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa1998ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.859899:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1998f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.859922:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1998f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.859930:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1998f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782756273.859981:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1998f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.860001:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1998e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.860007:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1998e8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.860015:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1998e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.860022:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756273.860027:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1998e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.860042:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1998e8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.860059:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:1.0:1782756273.860062:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756273.860110:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1998e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.860119:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5000/0x5e4fb0a8aa1998e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.860138:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa1998ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.860145:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa1998ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.860164:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa1998ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.860171:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5e00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756273.860174:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa1998ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.860181:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa1998ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.860188:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d3c540df600) 00010000:00010000:1.0:1782756273.860191:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756273.860195:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa1998ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.860211:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5e00/0x5e4fb0a8aa1998ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.860228:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1998f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.860234:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1998f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.860239:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1998f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.860244:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4c00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756273.860247:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1998f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.860252:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1998f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.860260:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212900) 00010000:00010000:1.0:1782756273.860262:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756273.860265:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1998f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756273.860271:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4c00/0x5e4fb0a8aa1998f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756273.860460:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+32:11525:x1869355210065024:12345-192.168.204.25@tcp:34:lfs.0 Request processed in 1138us (1844us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756273.860472:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 194 00000100:00100000:1.0:1782756273.903308:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756273.903398:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210065280 00000100:00100000:0.0:1782756273.903415:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210065280 00000100:00100000:0.0:1782756273.903510:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 195 00000100:00100000:0.0:1782756273.903521:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76e0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+32:11528:x1869355210065280:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1782756273.903543:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756273.903566:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1998fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce188 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.903643:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa199904 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.903658:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa199904 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.903670:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa199904 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.903683:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19990b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.903691:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19990b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.903891:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19990b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.904267:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa199912 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.904276:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa199912 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.904284:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa199912 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782756273.904294:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1782756273.904386:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa199904 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.904394:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa199904 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.904400:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa199904 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.904406:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81aa00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756273.904411:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa199904 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.904418:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa199904 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.904430:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:0.0:1782756273.904433:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756273.904444:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa199904 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.904450:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa199904 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.904463:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19990b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.904469:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19990b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.904475:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19990b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.904480:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81a200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756273.904484:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19990b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.904490:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19990b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.904497:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d3c54288800) 00010000:00010000:0.0:1782756273.904499:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756273.904501:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19990b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.904506:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19990b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.904549:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa1998fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce188 expref: 35 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.904579:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa199912 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce188 expref: 34 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.905184:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212900) 00010000:00010000:0.0:1782756273.905187:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1782756273.905190:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4b81b000, rc 0) 00000100:00100000:0.0:1782756273.905321:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76e0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+34:11528:x1869355210065280:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1799us (2027us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1782756273.905331:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 195 00000100:00100000:1.0:1782756273.915674:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756273.917308:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210065408 00000100:00100000:3.0:1782756273.917324:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210065408 00000100:00100000:3.0:1782756273.917417:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 196 00000100:00100000:3.0:1782756273.917430:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76e0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+34:11528:x1869355210065408:12345-192.168.204.25@tcp:54:lfs.0 00010000:00010000:3.0:1782756273.917540:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199920 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.917562:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1998c5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce173 expref: 34 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.917574:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199920 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.917622:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1998c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce173 expref: 34 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.917639:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1998c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce173 expref: 34 pid: 5805 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756273.917663:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7ff34e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1869355222634880:192.168.204.25@tcp:104: 00000100:00100000:3.0:1782756273.917832:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78a01780 going to sleep for 11 seconds 00000100:00100000:2.0:1782756273.922551:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756273.922818:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7ff34e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1869355222634880:192.168.204.25@tcp:104: 00010000:00010000:3.0:1782756273.922853:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199920 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756273.923273:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210065664 00000100:00100000:1.0:1782756273.923283:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210065664 00000100:00100000:1.0:1782756273.923474:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 52 00000100:00100000:1.0:1782756273.923487:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c50165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+35:5577:x1869355210065664:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1782756273.923950:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c50165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+36:5577:x1869355210065664:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 463us (1411us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1782756273.923960:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 52 00000100:00100000:0.0:1782756273.929047:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756273.929258:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210065792 00000100:00100000:3.0:1782756273.929273:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210065792 00010000:00010000:3.0:1782756273.929330:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1998c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce173 expref: 36 pid: 5805 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756273.929386:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 75 00000100:00100000:3.0:1782756273.929398:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c501d4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+36:2355:x1869355210065792:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782756273.929450:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756273.929459:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1998c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce173 expref: 36 pid: 5805 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.929476:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1998c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce173 expref: 36 pid: 5805 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.929505:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5200/0x5e4fb0a8aa1998c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce173 expref: 36 pid: 5805 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.929528:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212900) 00010000:00010000:3.0:1782756273.929534:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199920 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.929547:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199920 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.929556:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199920 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756273.929602:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782756273.929684:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c501d4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+35:2355:x1869355210065792:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 288us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756273.929694:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 75 00010000:00010000:0.0:1782756273.929984:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199920 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.929995:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199920 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.930040:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199920 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.930048:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199920 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.930055:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199920 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.930061:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168cc00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756273.930066:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199920 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.930120:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199920 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.930132:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212900) 00010000:00010000:0.0:1782756273.930135:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782756273.930139:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199920 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756273.930146:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199920 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756273.930198:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76e0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+34:11528:x1869355210065408:12345-192.168.204.25@tcp:54:lfs.0 Request processed in 12771us (14540us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756273.930208:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 196 00000100:00100000:2.0:1782756273.933571:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756273.933617:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210066048 00000100:00100000:0.0:1782756273.933630:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210066048 00000100:00100000:0.0:1782756273.933694:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 53 00000100:00100000:0.0:1782756273.933705:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c50164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+34:11528:x1869355210066048:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:0.0:1782756273.934195:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c50164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+35:11528:x1869355210066048:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 488us (635us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1782756273.934205:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 53 00000100:00100000:1.0:1782756273.997742:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756273.997901:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210066304 00000100:00100000:2.0:1782756273.997916:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210066304 00000100:00100000:2.0:1782756273.998021:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 197 00000100:00100000:2.0:1782756273.998033:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76e0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+35:11539:x1869355210066304:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1782756273.998109:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756273.998139:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa199927 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce18f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.998248:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19992e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.998268:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19992e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.998282:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19992e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.998321:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199935 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.998329:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199935 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.998337:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199935 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.998768:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19993c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.998780:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19993c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.998787:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19993c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756273.998798:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1782756273.998929:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19992e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.998938:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19992e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.998945:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19992e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.998951:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63cc00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756273.998957:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19992e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.998979:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19992e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.998996:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:2.0:1782756273.999000:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756273.999007:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19992e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.999015:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19992e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.999032:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199935 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.999039:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199935 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.999046:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199935 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.999051:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63c000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756273.999054:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199935 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.999059:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199935 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.999066:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d3c58212000) 00010000:00010000:2.0:1782756273.999127:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756273.999131:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199935 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.999148:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa199935 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.999212:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa199927 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce18f expref: 38 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.999228:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19993c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce18f expref: 37 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756273.999237:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212900) 00010000:00010000:2.0:1782756273.999239:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782756273.999242:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63d000, rc 0) 00000100:00100000:2.0:1782756273.999338:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76e0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+37:11539:x1869355210066304:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1306us (1610us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1782756273.999346:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 197 00000100:00100000:1.0:1782756274.007357:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756274.007655:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210066560 00000100:00100000:2.0:1782756274.007671:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210066560 00000100:00100000:2.0:1782756274.007749:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 54 00000100:00100000:2.0:1782756274.007762:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+37:11539:x1869355210066560:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:2.0:1782756274.008808:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+38:11539:x1869355210066560:12345-192.168.204.25@tcp:35:cat.0 Request processed in 1038us (1452us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1782756274.008823:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 54 00000100:00100000:3.0:1782756274.025899:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756274.027488:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210066816 00000100:00100000:0.0:1782756274.027505:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210066816 00000100:00100000:0.0:1782756274.027606:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 198 00000100:00100000:0.0:1782756274.027619:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7ff34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+38:11540:x1869355210066816:12345-192.168.204.25@tcp:36:rm.0 00010000:00010000:0.0:1782756274.027687:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1782756274.028010:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19993c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce18f expref: 38 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.028052:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b000/0x5e4fb0a8aa199912 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce188 expref: 37 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.028158:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa1998da lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce17a expref: 36 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.028651:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c58212900) 00010000:00010000:0.0:1782756274.028667:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782756274.028692:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19994a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.028706:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19994a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.028728:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19994a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.028744:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa199951 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.028752:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa199951 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.028758:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa199951 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.029566:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa199958 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.029591:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa199958 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.029610:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa199958 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782756274.030551:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1782756274.030568:0:5803:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 315265492083ns, next at 316265484989ns, rc = 0 00010000:00010000:0.0:1782756274.030666:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17e00/0x5e4fb0a8aa19995f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.030679:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17e00/0x5e4fb0a8aa19995f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.030689:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17e00/0x5e4fb0a8aa19995f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.030697:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17e00/0x5e4fb0a8aa19995f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.030704:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17e00/0x5e4fb0a8aa19995f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.030711:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17e00/0x5e4fb0a8aa19995f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.030797:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782756274.030825:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa199958 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.030833:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa199958 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.030839:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa199958 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.030851:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81be00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756274.030856:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa199958 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.030864:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa199958 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.030876:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c54288200) 00010000:00010000:0.0:1782756274.030880:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782756274.030884:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa199958 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.030890:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81be00/0x5e4fb0a8aa199958 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.030910:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19994a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.030916:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19994a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.030923:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19994a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.030928:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81a200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756274.030931:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19994a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.030937:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19994a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.030954:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:0.0:1782756274.030957:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756274.030960:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19994a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.030968:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81a200/0x5e4fb0a8aa19994a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782756274.030978:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007451421c reply state 000000002a8441cf transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa199951 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756274.031000:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782756274.031207:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7ff34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+37:11540:x1869355210066816:12345-192.168.204.25@tcp:36:rm.0 Request processed in 3586us (5385us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1782756274.031216:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 198 00010000:00010000:1.0:1782756274.031637:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782756274.031644:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17e00/0x5e4fb0a8aa19995f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.031652:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c76e17e00 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:1.0:1782756274.031655:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17e00/0x5e4fb0a8aa19995f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.031662:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17e00/0x5e4fb0a8aa19995f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.031672:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d3c54288200) 00010000:00010000:1.0:1782756274.031674:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782756274.031677:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17e00/0x5e4fb0a8aa19995f lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.031682:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17e00/0x5e4fb0a8aa19995f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.031697:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756274.031699:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756274.031701:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756274.034794:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa199951 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756274.034827:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa199951 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756274.034861:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa199951 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756274.034868:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81aa00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756274.034873:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa199951 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756274.034882:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa199951 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756274.034898:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d3c54288800) 00010000:00010000:2.0:1782756274.034902:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756274.034906:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa199951 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756274.034912:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81aa00/0x5e4fb0a8aa199951 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756274.064137:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756274.064276:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210067072 00000100:00100000:0.0:1782756274.064290:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210067072 00000100:00100000:0.0:1782756274.064377:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 199 00000100:00100000:0.0:1782756274.064386:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7ff34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+36:11546:x1869355210067072:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:0.0:1782756274.064416:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756274.064436:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16600/0x5e4fb0a8aa199966 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce196 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.064571:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17800/0x5e4fb0a8aa19996d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.064589:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17800/0x5e4fb0a8aa19996d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.064621:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17800/0x5e4fb0a8aa19996d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.064636:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17a00/0x5e4fb0a8aa199974 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.064644:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17a00/0x5e4fb0a8aa199974 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.064651:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17a00/0x5e4fb0a8aa199974 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782756274.065262:0:5804:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1782756274.065416:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16e00/0x5e4fb0a8aa19997b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.065427:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16e00/0x5e4fb0a8aa19997b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.065435:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16e00/0x5e4fb0a8aa19997b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.065466:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17800/0x5e4fb0a8aa19996d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.065473:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17800/0x5e4fb0a8aa19996d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.065480:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17800/0x5e4fb0a8aa19996d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.065486:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c76e17800 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756274.065498:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17800/0x5e4fb0a8aa19996d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.065506:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17800/0x5e4fb0a8aa19996d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.065524:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:0.0:1782756274.065527:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756274.065531:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17800/0x5e4fb0a8aa19996d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.065537:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17800/0x5e4fb0a8aa19996d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782756274.065549:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c82af62c reply state 00000000150f1319 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17a00/0x5e4fb0a8aa199974 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756274.065563:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782756274.065594:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16600/0x5e4fb0a8aa199966 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce196 expref: 39 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.065607:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16e00/0x5e4fb0a8aa19997b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce196 expref: 38 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.070350:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288e00) 00010000:00010000:0.0:1782756274.070355:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782756274.070359:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c76e16e00, rc 0) 00000100:00100000:0.0:1782756274.070452:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7ff34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+39:11546:x1869355210067072:12345-192.168.204.25@tcp:101:bash.0 Request processed in 6063us (6678us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1782756274.070462:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 199 00010000:00010000:3.0:1782756274.078708:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17a00/0x5e4fb0a8aa199974 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.078745:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17a00/0x5e4fb0a8aa199974 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.078753:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17a00/0x5e4fb0a8aa199974 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.078758:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c76e17a00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756274.078763:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17a00/0x5e4fb0a8aa199974 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.078771:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17a00/0x5e4fb0a8aa199974 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.078787:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d3c54288300) 00010000:00010000:3.0:1782756274.078790:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756274.078793:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17a00/0x5e4fb0a8aa199974 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.078799:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17a00/0x5e4fb0a8aa199974 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756274.080934:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756274.081034:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210067200 00000100:00100000:1.0:1782756274.081058:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210067200 00000100:00100000:1.0:1782756274.081149:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 60 00000100:00100000:1.0:1782756274.081160:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7ff37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+5:2355:x1869355210067200:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:1.0:1782756274.081181:0:6602:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756274.081205:0:6602:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199989 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce19d expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782756274.081501:0:6602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782756274.081536:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=315s v=(0 0) 00010000:00010000:1.0:1782756274.081542:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756274.081552:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199989 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce19d expref: 6 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.081717:0:6602:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199989 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce19d expref: 6 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.081731:0:6602:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef4a00, rc 0) 00000100:00100000:1.0:1782756274.081846:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7ff37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+6:2355:x1869355210067200:12345-192.168.204.25@tcp:101:bash.0 Request processed in 687us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756274.081854:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 60 00000100:00100000:1.0:1782756274.091413:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756274.091485:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210067328 00000100:00100000:3.0:1782756274.091496:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210067328 00000100:00100000:3.0:1782756274.091570:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 61 00000100:00100000:3.0:1782756274.091582:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+6:11546:x1869355210067328:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:3.0:1782756274.091608:0:6603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756274.091633:0:6603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec8f52d7/0x5e4fb0a8aa199990 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce1a4 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.091685:0:6603:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199989 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce19d expref: 7 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.091694:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756274.091699:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756274.091703:0:6603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec8f52d7/0x5e4fb0a8aa199990 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1a4 expref: 7 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.091737:0:6603:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199989 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce19d expref: 7 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.091750:0:6603:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199989 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce19d expref: 7 pid: 6602 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756274.091766:0:6603:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7ff34e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6603:1869355222635008:192.168.204.25@tcp:104: 00000100:00100000:3.0:1782756274.091878:0:6603:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78a01000 going to sleep for 11 seconds 00000100:00100000:2.0:1782756274.094508:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756274.094537:0:6603:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7ff34e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6603:1869355222635008:192.168.204.25@tcp:104: 00010000:00010000:3.0:1782756274.094737:0:6603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ec8f52d7/0x5e4fb0a8aa199990 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1a4 expref: 7 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.094764:0:6603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168ca00, rc 0) 00000100:00100000:1.0:1782756274.094792:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210067456 00000100:00100000:1.0:1782756274.094799:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210067456 00010000:00010000:1.0:1782756274.094832:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199989 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce19d expref: 8 pid: 6602 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756274.094895:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+8:11546:x1869355210067328:12345-192.168.204.25@tcp:101:bash.0 Request processed in 3315us (3493us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756274.094904:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 61 00000100:00100000:1.0:1782756274.094909:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 76 00000100:00100000:1.0:1782756274.094938:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26487635-60cb-4aee-af8e-396654f6c3d8+7:2356:x1869355210067456:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782756274.094966:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756274.094990:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199989 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce19d expref: 7 pid: 6602 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.095003:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199989 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce19d expref: 7 pid: 6602 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.095027:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199989 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce19d expref: 7 pid: 6602 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.095042:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756274.095046:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756274.095054:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec8f52d7/0x5e4fb0a8aa199990 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1a4 expref: 6 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.095064:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec8f52d7/0x5e4fb0a8aa199990 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1a4 expref: 6 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.095140:0:5790:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ec8f52d7/0x5e4fb0a8aa199990 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1a4 expref: 6 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756274.095167:0:5790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76e0ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5790:1869355222635136:192.168.204.25@tcp:105: 00000100:00100000:1.0:1782756274.095219:0:5790:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3b42980480 going to sleep for 11 seconds 00000100:00100000:2.0:1782756274.103225:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756274.103298:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210067712 00000100:00100000:0.0:1782756274.103311:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210067712 00000100:00100000:0.0:1782756274.103390:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 55 00000100:00100000:1.0:1782756274.103392:0:5790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76e0ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5790:1869355222635136:192.168.204.25@tcp:105: 00000100:00100000:0.0:1782756274.103401:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+38:11546:x1869355210067712:12345-192.168.204.25@tcp:35:bash.0 00010000:00010000:1.0:1782756274.103440:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756274.105526:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+39:11546:x1869355210067712:12345-192.168.204.25@tcp:35:bash.0 Request processed in 2114us (2304us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1782756274.105542:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 55 00000100:00100000:1.0:1782756274.107621:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26487635-60cb-4aee-af8e-396654f6c3d8+6:2356:x1869355210067456:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 12686us (13116us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756274.107635:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 76 00000100:00100000:2.0:1782756274.223542:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756274.224882:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210067840 00000100:00100000:0.0:1782756274.224894:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210067840 00000100:00100000:0.0:1782756274.224963:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 200 00000100:00100000:0.0:1782756274.224974:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4b605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+39:11562:x1869355210067840:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1782756274.225014:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756274.225036:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16600/0x5e4fb0a8aa199997 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce1ab expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.225156:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17800/0x5e4fb0a8aa19999e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.225692:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17800/0x5e4fb0a8aa19999e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.225705:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17800/0x5e4fb0a8aa19999e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782756274.225775:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1782756274.225780:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782756274.225805:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17800/0x5e4fb0a8aa19999e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.225838:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16600/0x5e4fb0a8aa199997 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1ab expref: 41 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.225870:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17800/0x5e4fb0a8aa19999e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1ab expref: 40 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.225876:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:0.0:1782756274.225879:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782756274.225881:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c76e17800, rc 0) 00000100:00100000:0.0:1782756274.225943:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4b605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+40:11562:x1869355210067840:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 970us (2413us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756274.225950:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 200 00000100:00100000:0.0:1782756274.231671:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756274.231900:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210068096 00000100:00100000:1.0:1782756274.231912:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210068096 00000100:00100000:1.0:1782756274.231979:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 201 00000100:00100000:1.0:1782756274.231990:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+40:11562:x1869355210068096:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1782756274.232014:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756274.232037:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4a00/0x5e4fb0a8aa1999a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce1b2 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.232182:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1999ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.232199:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1999ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.232211:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1999ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756274.232224:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1782756274.232391:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4a00/0x5e4fb0a8aa1999a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1b2 expref: 43 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.232413:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1999ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1b2 expref: 42 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.232422:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288e00) 00010000:00010000:1.0:1782756274.232442:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782756274.232447:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef4e00, rc 0) 00000100:00100000:1.0:1782756274.232525:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+42:11562:x1869355210068096:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 536us (866us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1782756274.232533:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 201 00000100:00100000:2.0:1782756274.243939:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756274.246656:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210068352 00000100:00100000:0.0:1782756274.246675:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210068352 00000100:00100000:0.0:1782756274.246845:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 202 00000100:00100000:0.0:1782756274.246863:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+42:11562:x1869355210068352:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1782756274.246899:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1782756274.246930:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1782756274.246930:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16600/0x5e4fb0a8aa1999ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce1b9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.247061:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa1999c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.247146:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa1999c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.247159:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa1999c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782756274.247193:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00000100:00100000:2.0:1782756274.247304:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210068480 00000100:00100000:2.0:1782756274.247315:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210068480 00010000:00010000:0.0:1782756274.247374:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16600/0x5e4fb0a8aa1999ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1b9 expref: 46 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756274.247387:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15 00010000:00010000:0.0:1782756274.247408:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa1999c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1b9 expref: 45 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756274.247409:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7ff34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+45:2355:x1869355210068480:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782756274.247439:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288e00) 00010000:00010000:2.0:1782756274.247442:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756274.247444:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1782756274.247450:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c76e16200, rc 0) 00010000:00010000:2.0:1782756274.247485:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4e00/0x5e4fb0a8aa1999ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1b2 expref: 45 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756274.247524:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288e00) 00010000:00010000:2.0:1782756274.247531:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756274.247545:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+44:11562:x1869355210068352:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 685us (3613us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1782756274.247554:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 202 00000100:00100000:2.0:1782756274.247764:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7ff34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+43:2355:x1869355210068480:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 181us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756274.247775:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15 00000040:00080000:0.0:1782756274.252793:0:11537:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782756274.252804:0:11537:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1782756274.253433:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000040:00080000:0.0:1782756274.253442:0:11537:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1782756274.253453:0:11537:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782756274.254105:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210068608 00000100:00100000:1.0:1782756274.254116:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210068608 00000100:00100000:1.0:1782756274.254195:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 62 00000100:00100000:1.0:1782756274.254209:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+6:2358:x1869355210068608:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:1.0:1782756274.254263:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa1999cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.254286:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec8f52d7/0x5e4fb0a8aa199990 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1a4 expref: 6 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.254295:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756274.254299:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782756274.254304:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa1999cf lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.254551:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ec8f52d7/0x5e4fb0a8aa199990 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1a4 expref: 6 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.254569:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ec8f52d7/0x5e4fb0a8aa199990 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1a4 expref: 6 pid: 6603 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756274.254589:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76e0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6605:1869355222635264:192.168.204.25@tcp:104: 00000100:00100000:1.0:1782756274.254723:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3b42980480 going to sleep for 11 seconds 00000100:00100000:3.0:1782756274.258533:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756274.258587:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76e0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6605:1869355222635264:192.168.204.25@tcp:104: 00010000:00010000:1.0:1782756274.258621:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa1999cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756274.258642:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210068736 00000100:00100000:0.0:1782756274.258649:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210068736 00002000:00100000:0.0:1782756274.258701:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9d3c7ff36300 x1869355210068736/t0(0) o4->26487635-60cb-4aee-af8e-396654f6c3d8@192.168.204.25@tcp:455/0 lens 504/0 e 0 to 0 dl 1782756285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782756274.258711:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3c7ff36300 with x1869355210068736 ext(0->8) 00010000:00010000:0.0:1782756274.258723:0:6610:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ec8f52d7/0x5e4fb0a8aa199990 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1a4 expref: 7 pid: 6603 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.258739:0:6610:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ec8f52d7/0x5e4fb0a8aa199990 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1a4 expref: 7 pid: 6603 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782756274.258761:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d3c7ff36300 00000100:00100000:0.0:1782756274.258800:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 2 00000100:00100000:0.0:1782756274.258810:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7ff36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26487635-60cb-4aee-af8e-396654f6c3d8+7:2356:x1869355210068736:12345-192.168.204.25@tcp:4:lfs.0 00000100:00100000:0.0:1782756274.260514:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7ff36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26487635-60cb-4aee-af8e-396654f6c3d8+9:2356:x1869355210068736:12345-192.168.204.25@tcp:4:lfs.0 Request processed in 1697us (1990us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1782756274.260529:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 2 00002000:00100000:0.0:1782756274.260541:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9d3c7ff36300 x1869355210068736/t4294967308(0) o4->26487635-60cb-4aee-af8e-396654f6c3d8@192.168.204.25@tcp:455/0 lens 504/448 e 0 to 0 dl 1782756285 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782756274.260553:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3c7ff36300 with x1869355210068736 ext(0->8) 00010000:00010000:0.0:1782756274.260564:0:6610:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ec8f52d7/0x5e4fb0a8aa199990 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1a4 expref: 9 pid: 6603 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.260715:0:6610:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ec8f52d7/0x5e4fb0a8aa199990 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1a4 expref: 9 pid: 6603 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782756274.260725:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d3c7ff36300 00000100:00100000:2.0:1782756274.262496:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756274.262756:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210068864 00000100:00100000:0.0:1782756274.262768:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210068864 00010000:00010000:0.0:1782756274.262834:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ec8f52d7/0x5e4fb0a8aa199990 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1a4 expref: 9 pid: 6603 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756274.262898:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 77 00000100:00100000:0.0:1782756274.262912:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77000a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+9:2355:x1869355210068864:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782756274.263381:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1782756274.263407:0:5788:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1782756274.263410:0:5788:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1782756273 00002000:00010000:0.0:1782756274.263412:0:5788:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1782756273 00002000:00010000:0.0:1782756274.263415:0:5788:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1782756273 00010000:00010000:0.0:1782756274.263423:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ec8f52d7/0x5e4fb0a8aa199990 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1a4 expref: 9 pid: 6603 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.263441:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ec8f52d7/0x5e4fb0a8aa199990 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1a4 expref: 9 pid: 6603 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.263471:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec8f52d7/0x5e4fb0a8aa199990 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1a4 expref: 9 pid: 6603 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.263495:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782756274.263500:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782756274.263506:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa1999cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.263519:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa1999cf lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.263609:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756274.263685:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77000a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+8:2355:x1869355210068864:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 776us (1203us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756274.263693:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 77 00010000:00010000:1.0:1782756274.264554:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa1999cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.264574:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa1999cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.264616:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa1999cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.264626:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa1999cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.264634:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa1999cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.264642:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4a00 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:1.0:1782756274.264647:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa1999cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.264657:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa1999cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.264694:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa1999cf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.264702:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa1999cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756274.268792:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+7:2358:x1869355210068608:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 14566us (15352us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756274.268814:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 62 00000100:00100000:2.0:1782756274.272246:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756274.272548:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210069120 00000100:00100000:1.0:1782756274.272565:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210069120 00000100:00100000:1.0:1782756274.272648:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 56 00000100:00100000:1.0:1782756274.272660:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4977b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+43:11562:x1869355210069120:12345-192.168.204.25@tcp:35:lfs.0 00000004:00010000:1.0:1782756274.272752:0:5807:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa1999c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1b9 expref: 43 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782756274.273639:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1782756274.273702:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1782756274.274193:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1782756274.274262:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1999d6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.274285:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16e00/0x5e4fb0a8aa19997b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce196 expref: 47 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.274296:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1999d6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.277618:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16e00/0x5e4fb0a8aa19997b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce196 expref: 47 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.277646:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16e00/0x5e4fb0a8aa19997b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce196 expref: 47 pid: 5804 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756274.277667:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76e0ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5807:1869355222635392:192.168.204.25@tcp:104: 00000100:00100000:1.0:1782756274.277810:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c49ec2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782756274.285620:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756274.285775:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210069248 00000100:00100000:3.0:1782756274.285787:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210069248 00010000:00010000:3.0:1782756274.285845:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16e00/0x5e4fb0a8aa19997b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce196 expref: 48 pid: 5804 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756274.285902:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 78 00000100:00100000:3.0:1782756274.285915:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+48:2355:x1869355210069248:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782756274.285945:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756274.285954:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16e00/0x5e4fb0a8aa19997b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce196 expref: 48 pid: 5804 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.285970:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16e00/0x5e4fb0a8aa19997b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce196 expref: 48 pid: 5804 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.285998:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288e00) 00010000:00010000:3.0:1782756274.286005:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1999d6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.286017:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1999d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.286025:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1999d6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.286049:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782756274.286361:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16e00/0x5e4fb0a8aa19997b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce196 expref: 48 pid: 5804 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756274.286384:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76e0ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5807:1869355222635392:192.168.204.25@tcp:104: 00010000:00010000:1.0:1782756274.286412:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1999d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.286422:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1999d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.286429:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1999d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782756274.286679:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000100:00100000:0.0:1782756274.286687:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+47:2355:x1869355210069248:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 773us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756274.286697:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 78 00000001:00080000:0.0:1782756274.287006:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1782756274.287201:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419f8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1869355222635520:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782756274.287270:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756274.287309:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78a50f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782756274.287368:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222635520 00000100:00100000:2.0:1782756274.287376:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222635520 00000100:00100000:2.0:1782756274.287428:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782756274.287438:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5807:x1869355222635520:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1782756274.288490:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5807:x1869355222635520:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1046us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756274.288501:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782756274.290315:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419f8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1869355222635520:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1782756274.291348:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1782756274.291465:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419f8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1869355222635648:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782756274.291557:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756274.291658:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76f31900 going to sleep for 11 seconds 00000100:00100000:3.0:1782756274.291700:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222635648 00000100:00100000:3.0:1782756274.291710:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222635648 00000100:00100000:3.0:1782756274.291841:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782756274.291862:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5807:x1869355222635648:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1782756274.292566:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5807:x1869355222635648:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 703us (1005us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1782756274.292576:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782756274.292661:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419f8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1869355222635648:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1782756274.292732:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1782756274.292794:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1999d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.292806:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1999d6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.292814:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1999d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.292820:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756274.292826:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1999d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.292834:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1999d6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.292867:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288e00) 00010000:00010000:0.0:1782756274.292870:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1782756274.292875:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1999d6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.292882:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4000/0x5e4fb0a8aa1999d6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782756274.293159:0:5807:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1782756274.293340:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1782756274.293353:0:5807:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 315528277487ns, next at 316528275107ns, rc = 0 00000001:00080000:0.0:1782756274.293361:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1782756274.293396:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288e00) 00010000:00010000:0.0:1782756274.293399:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1782756274.293409:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa1999c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1b9 expref: 51 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756274.293542:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4977b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+50:11562:x1869355210069120:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 20884us (21312us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1782756274.293553:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 56 00000020:00080000:0.0:1782756274.293557:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1782756274.296351:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756274.297533:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210069376 00000100:00100000:0.0:1782756274.297550:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210069376 00000100:00100000:0.0:1782756274.297673:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 203 00000100:00100000:0.0:1782756274.297687:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+50:11562:x1869355210069376:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1782756274.297733:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756274.297774:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16600/0x5e4fb0a8aa1999dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce1c0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.297901:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16600/0x5e4fb0a8aa1999dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1c0 expref: 51 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.297919:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16600/0x5e4fb0a8aa1999dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1c0 expref: 51 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.297947:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:0.0:1782756274.297951:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782756274.297955:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c76e16600, rc 0) 00000100:00100000:0.0:1782756274.298039:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+51:11562:x1869355210069376:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 356us (1699us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756274.298048:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 203 00000100:00100000:1.0:1782756274.305813:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756274.308869:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210069632 00000100:00100000:0.0:1782756274.308898:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210069632 00000100:00100000:0.0:1782756274.309026:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 57 00000100:00100000:2.0:1782756274.309355:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+51:11562:x1869355210069632:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:2.0:1782756274.309706:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+52:11562:x1869355210069632:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 468us (3907us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1782756274.309792:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 57 00000100:00100000:3.0:1782756274.382319:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756274.382580:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210069760 00000100:00100000:1.0:1782756274.382595:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210069760 00000100:00100000:1.0:1782756274.382728:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 204 00000100:00100000:1.0:1782756274.382742:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7ff35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+52:11572:x1869355210069760:12345-192.168.204.25@tcp:34:lfs.0 00010000:00010000:1.0:1782756274.382871:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1999e4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.382894:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1999e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.382909:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1999e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.382927:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1999eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.382935:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1999eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.382942:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1999eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.383143:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1999f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.383153:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1999f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.383162:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1999f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782756274.383219:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1999f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.383234:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1999e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.383253:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1999e4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.383262:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1999e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.383269:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756274.383274:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1999e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.383284:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1999e4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.383304:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:1.0:1782756274.383308:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756274.383313:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1999e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.383320:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa1999e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.383336:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1999eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.383342:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1999eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.383348:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1999eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.383353:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5a00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756274.383362:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1999eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.383368:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1999eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.383376:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d3c540df600) 00010000:00010000:1.0:1782756274.383379:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756274.383381:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1999eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.383397:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa1999eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.383416:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1999f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.383423:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1999f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.383429:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1999f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.383434:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5c00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756274.383437:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1999f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.383443:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1999f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.383450:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:1.0:1782756274.383452:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756274.383461:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1999f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.383467:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5c00/0x5e4fb0a8aa1999f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756274.383587:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7ff35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+52:11572:x1869355210069760:12345-192.168.204.25@tcp:34:lfs.0 Request processed in 845us (1287us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756274.383596:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 204 00000100:00100000:2.0:1782756274.411415:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756274.411556:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210070016 00000100:00100000:0.0:1782756274.411571:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210070016 00000100:00100000:0.0:1782756274.411657:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 205 00000100:00100000:0.0:1782756274.411671:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+52:11575:x1869355210070016:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1782756274.411704:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756274.411732:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa1999f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce1c7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.411870:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16c00/0x5e4fb0a8aa199a00 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.411889:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16c00/0x5e4fb0a8aa199a00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.411924:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16c00/0x5e4fb0a8aa199a00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.411943:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17400/0x5e4fb0a8aa199a07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.411951:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17400/0x5e4fb0a8aa199a07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.411958:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17400/0x5e4fb0a8aa199a07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.412193:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17200/0x5e4fb0a8aa199a0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.412201:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17200/0x5e4fb0a8aa199a0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.412209:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17200/0x5e4fb0a8aa199a0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782756274.412221:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1782756274.412356:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16c00/0x5e4fb0a8aa199a00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.412364:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16c00/0x5e4fb0a8aa199a00 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.412370:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16c00/0x5e4fb0a8aa199a00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.412376:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c76e16c00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756274.412388:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16c00/0x5e4fb0a8aa199a00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.412396:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16c00/0x5e4fb0a8aa199a00 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.412410:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:0.0:1782756274.412415:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756274.412420:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16c00/0x5e4fb0a8aa199a00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.412426:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16c00/0x5e4fb0a8aa199a00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.412442:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17400/0x5e4fb0a8aa199a07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.412449:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17400/0x5e4fb0a8aa199a07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.412455:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17400/0x5e4fb0a8aa199a07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.412460:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c76e17400 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756274.412462:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17400/0x5e4fb0a8aa199a07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.412468:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17400/0x5e4fb0a8aa199a07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.412475:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d3c54288e00) 00010000:00010000:0.0:1782756274.412477:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756274.412486:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17400/0x5e4fb0a8aa199a07 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.412493:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17400/0x5e4fb0a8aa199a07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.412545:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa1999f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1c7 expref: 55 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.412561:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17200/0x5e4fb0a8aa199a0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1c7 expref: 54 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.412568:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:0.0:1782756274.412571:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782756274.412574:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c76e17200, rc 0) 00000100:00100000:0.0:1782756274.412669:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+54:11575:x1869355210070016:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1001us (1271us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1782756274.412679:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 205 00000100:00100000:2.0:1782756274.420537:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756274.423617:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210070144 00000100:00100000:0.0:1782756274.423639:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210070144 00000100:00100000:0.0:1782756274.423798:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 206 00000100:00100000:0.0:1782756274.423812:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+54:11575:x1869355210070144:12345-192.168.204.25@tcp:54:lfs.0 00010000:00010000:0.0:1782756274.423923:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199a1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.423948:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199a1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.423964:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199a1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.424210:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199a1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.424219:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199a1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.424228:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199a1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.424235:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c76e16200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756274.424241:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199a1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.424250:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199a1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.424268:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:0.0:1782756274.424272:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782756274.424279:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199a1c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.424286:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199a1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756274.424402:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+54:11575:x1869355210070144:12345-192.168.204.25@tcp:54:lfs.0 Request processed in 591us (3881us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756274.424412:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 206 00000100:00100000:3.0:1782756274.428486:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756274.428666:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210070400 00000100:00100000:2.0:1782756274.428755:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210070400 00000100:00100000:2.0:1782756274.429026:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 58 00000100:00100000:2.0:1782756274.429040:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7ff36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+54:11575:x1869355210070400:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:2.0:1782756274.429456:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7ff36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+55:11575:x1869355210070400:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 416us (984us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1782756274.429466:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 58 00000100:00100000:2.0:1782756274.479345:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756274.479454:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210070656 00000100:00100000:1.0:1782756274.479468:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210070656 00000100:00100000:1.0:1782756274.479553:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 207 00000100:00100000:1.0:1782756274.479567:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+55:11585:x1869355210070656:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:1.0:1782756274.479617:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756274.479622:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782756274.479661:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17800/0x5e4fb0a8aa19999e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1ab expref: 55 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.479688:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:1.0:1782756274.479694:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782756274.479713:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa199a23 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce1ce expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.479884:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa199a2a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.479901:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17200/0x5e4fb0a8aa199a0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1c7 expref: 55 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.479911:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa199a2a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.479963:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17200/0x5e4fb0a8aa199a0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1c7 expref: 55 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.479980:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17200/0x5e4fb0a8aa199a0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1c7 expref: 55 pid: 5804 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756274.480016:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76e0e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1869355222635776:192.168.204.25@tcp:104: 00000100:00100000:1.0:1782756274.480226:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c49ec2780 going to sleep for 11 seconds 00000100:00100000:1.0:1782756274.487466:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756274.487758:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210070784 00000100:00100000:3.0:1782756274.487773:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210070784 00010000:00010000:3.0:1782756274.487831:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17200/0x5e4fb0a8aa199a0e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1c7 expref: 56 pid: 5804 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756274.487887:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 79 00000100:00100000:3.0:1782756274.487900:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76e0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26487635-60cb-4aee-af8e-396654f6c3d8+56:2355:x1869355210070784:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782756274.487932:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756274.487940:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17200/0x5e4fb0a8aa199a0e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1c7 expref: 56 pid: 5804 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.487956:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17200/0x5e4fb0a8aa199a0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1c7 expref: 56 pid: 5804 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756274.487956:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76e0e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1869355222635776:192.168.204.25@tcp:104: 00010000:00010000:3.0:1782756274.487999:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17200/0x5e4fb0a8aa199a0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1c7 expref: 56 pid: 5804 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.488010:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa199a2a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.488019:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:3.0:1782756274.488026:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa199a2a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.488056:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa199a2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.488125:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa199a2a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.489865:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782756274.490072:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76e0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26487635-60cb-4aee-af8e-396654f6c3d8+55:2355:x1869355210070784:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2156us (2607us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756274.490114:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 79 00010000:00010000:0.0:1782756274.490297:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa199a2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.490310:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa199a2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782756274.490342:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1782756274.490597:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa199a23 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1ce expref: 56 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.490625:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa199a2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1ce expref: 55 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.490635:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:0.0:1782756274.490638:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782756274.490641:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef4200, rc 0) 00000100:00100000:0.0:1782756274.490682:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+55:11585:x1869355210070656:12345-192.168.204.25@tcp:101:bash.0 Request processed in 11117us (11354us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1782756274.490690:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 207 00000100:00100000:2.0:1782756274.493808:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756274.494258:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210071040 00000100:00100000:0.0:1782756274.494273:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210071040 00000100:00100000:0.0:1782756274.494755:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 208 00000100:00100000:0.0:1782756274.494770:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+55:11585:x1869355210071040:12345-192.168.204.25@tcp:36:bash.0 00010000:00010000:0.0:1782756274.495400:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199a38 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.495568:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199a38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.495600:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199a38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782756274.495674:0:6579:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1782756274.495703:0:6579:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000096b918b8 reply state 00000000f1d27ec8 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199a38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756274.495715:0:6579:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782756274.495935:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+58:11585:x1869355210071040:12345-192.168.204.25@tcp:36:bash.0 Request processed in 1165us (2138us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1782756274.495943:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 208 00000020:00080000:0.0:1782756274.495949:0:6579:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782756274.500863:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199a38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.500890:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199a38 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.500899:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199a38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.500905:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c76e16200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756274.500910:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199a38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.500930:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199a38 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.500954:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:1.0:1782756274.500958:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756274.500963:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199a38 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.500998:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199a38 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756274.502312:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756274.502415:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210071168 00000100:00100000:0.0:1782756274.502433:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210071168 00000100:00100000:0.0:1782756274.502512:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 209 00000100:00100000:0.0:1782756274.502526:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+57:11585:x1869355210071168:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:0.0:1782756274.502560:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756274.502587:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17400/0x5e4fb0a8aa199a3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce1d5 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.502706:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16c00/0x5e4fb0a8aa199a46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.502724:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa199a2a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1ce expref: 58 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.502735:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16c00/0x5e4fb0a8aa199a46 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.502796:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa199a2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1ce expref: 58 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.502813:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa199a2a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1ce expref: 58 pid: 5803 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756274.502830:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869355222635904:192.168.204.25@tcp:104: 00000100:00100000:0.0:1782756274.502938:0:5805:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78a506c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782756274.510709:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869355222635904:192.168.204.25@tcp:104: 00010000:00010000:0.0:1782756274.510757:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16c00/0x5e4fb0a8aa199a46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756274.515301:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756274.515374:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210071296 00000100:00100000:0.0:1782756274.515386:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210071296 00010000:00010000:0.0:1782756274.515433:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa199a2a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1ce expref: 59 pid: 5803 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756274.515476:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 80 00000100:00100000:0.0:1782756274.515485:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+59:2355:x1869355210071296:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782756274.515501:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756274.515508:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa199a2a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1ce expref: 59 pid: 5803 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.515520:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa199a2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1ce expref: 59 pid: 5803 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.515565:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4200/0x5e4fb0a8aa199a2a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1ce expref: 59 pid: 5803 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.515584:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:0.0:1782756274.515588:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16c00/0x5e4fb0a8aa199a46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.515598:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16c00/0x5e4fb0a8aa199a46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.515604:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16c00/0x5e4fb0a8aa199a46 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.515634:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756274.515698:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+58:2355:x1869355210071296:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 213us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756274.515704:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 80 00010000:00010000:3.0:1782756274.515770:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16c00/0x5e4fb0a8aa199a46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.515778:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16c00/0x5e4fb0a8aa199a46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782756274.515837:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1782756274.515841:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782756274.515874:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16c00/0x5e4fb0a8aa199a46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.515925:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17400/0x5e4fb0a8aa199a3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1d5 expref: 58 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.515944:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16c00/0x5e4fb0a8aa199a46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1d5 expref: 57 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.515952:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:3.0:1782756274.515955:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782756274.515965:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c76e16c00, rc 0) 00000100:00100000:3.0:1782756274.515998:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+57:11585:x1869355210071168:12345-192.168.204.25@tcp:101:bash.0 Request processed in 13475us (13696us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756274.516007:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 209 00000100:00100000:1.0:1782756274.524024:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756274.524164:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210071552 00000100:00100000:0.0:1782756274.524178:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210071552 00000100:00100000:0.0:1782756274.524263:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 59 00000100:00100000:0.0:1782756274.524278:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+57:11585:x1869355210071552:12345-192.168.204.25@tcp:35:bash.0 00000100:00100000:0.0:1782756274.524668:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+58:11585:x1869355210071552:12345-192.168.204.25@tcp:35:bash.0 Request processed in 392us (658us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1782756274.524677:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 59 00000100:00100000:2.0:1782756274.595374:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756274.595949:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210071680 00000100:00100000:0.0:1782756274.595965:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210071680 00000100:00100000:0.0:1782756274.596055:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 210 00000100:00100000:0.0:1782756274.596159:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+58:11591:x1869355210071680:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1782756274.596198:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756274.596232:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17c00/0x5e4fb0a8aa199a4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce1dc expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.596331:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199a54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.596350:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199a54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.596365:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199a54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782756274.596468:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1782756274.596472:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782756274.596499:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199a54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.596529:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17c00/0x5e4fb0a8aa199a4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1dc expref: 60 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.596554:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199a54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1dc expref: 59 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.596564:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:0.0:1782756274.596567:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782756274.596572:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c76e17600, rc 0) 00000100:00100000:0.0:1782756274.596663:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+59:11591:x1869355210071680:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 509us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756274.596682:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 210 00000100:00100000:3.0:1782756274.602577:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756274.603614:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210071808 00000100:00100000:0.0:1782756274.603629:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210071808 00000100:00100000:0.0:1782756274.603723:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 211 00000100:00100000:0.0:1782756274.603737:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7ff34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+59:11591:x1869355210071808:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1782756274.603762:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756274.603784:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17c00/0x5e4fb0a8aa199a5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce1e3 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.603860:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa199a62 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.603875:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa199a62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.603886:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa199a62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.603900:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16400/0x5e4fb0a8aa199a69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.603907:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16400/0x5e4fb0a8aa199a69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.603913:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16400/0x5e4fb0a8aa199a69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.604010:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16a00/0x5e4fb0a8aa199a70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.604038:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16a00/0x5e4fb0a8aa199a70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.604045:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16a00/0x5e4fb0a8aa199a70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782756274.604129:0:6579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1782756274.604134:0:6579:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782756274.604165:0:6579:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16a00/0x5e4fb0a8aa199a70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.604178:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16a00/0x5e4fb0a8aa199a70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.604187:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa199a62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.604193:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa199a62 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.604199:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa199a62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.604205:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c76e17000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756274.604209:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa199a62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.604217:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa199a62 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.604230:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:0.0:1782756274.604233:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756274.604245:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa199a62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.604251:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa199a62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.604273:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16400/0x5e4fb0a8aa199a69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.604280:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16400/0x5e4fb0a8aa199a69 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.604286:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16400/0x5e4fb0a8aa199a69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.604291:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c76e16400 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756274.604294:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16400/0x5e4fb0a8aa199a69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.604300:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16400/0x5e4fb0a8aa199a69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.604309:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d3c54288e00) 00010000:00010000:0.0:1782756274.604311:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756274.604315:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16400/0x5e4fb0a8aa199a69 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.604320:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16400/0x5e4fb0a8aa199a69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.604352:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17c00/0x5e4fb0a8aa199a5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1e3 expref: 61 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.604382:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16a00/0x5e4fb0a8aa199a70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1e3 expref: 60 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.604390:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:0.0:1782756274.604393:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782756274.604395:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c76e16a00, rc 0) 00000100:00100000:0.0:1782756274.604468:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7ff34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+60:11591:x1869355210071808:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 734us (1908us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756274.604476:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 211 00000100:00100000:1.0:1782756274.608733:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756274.608847:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756274.609018:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210072192 00000100:00100000:3.0:1782756274.609029:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210072192 00000100:00100000:3.0:1782756274.609135:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 212 00000100:00100000:3.0:1782756274.609147:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76e0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+60:11591:x1869355210072192:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1782756274.609171:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756274.609194:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199a77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce1ea expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.609317:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199a7e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.609333:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16c00/0x5e4fb0a8aa199a46 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1d5 expref: 61 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.609342:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16a00/0x5e4fb0a8aa199a70 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1e3 expref: 61 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.609351:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199a7e lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.609408:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16a00/0x5e4fb0a8aa199a70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1e3 expref: 61 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.609726:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16a00/0x5e4fb0a8aa199a70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1e3 expref: 61 pid: 6579 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756274.609760:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7ff37b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869355222636032:192.168.204.25@tcp:104: 00010000:00010000:3.0:1782756274.609881:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16c00/0x5e4fb0a8aa199a46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1d5 expref: 61 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.609891:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16c00/0x5e4fb0a8aa199a46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1d5 expref: 61 pid: 5805 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756274.609900:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76d7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869355222636160:192.168.204.25@tcp:104: 00000100:00100000:3.0:1782756274.609925:0:5805:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78a01000 going to sleep for 11 seconds 00000100:00100000:2.0:1782756274.611337:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210071936 00000100:00100000:2.0:1782756274.611348:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210071936 00010000:00010000:2.0:1782756274.611575:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16a00/0x5e4fb0a8aa199a70 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1e3 expref: 62 pid: 6579 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756274.611644:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 81 00000100:00100000:2.0:1782756274.611653:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c501d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+62:2356:x1869355210071936:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782756274.611667:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756274.611672:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16a00/0x5e4fb0a8aa199a70 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1e3 expref: 62 pid: 6579 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756274.611684:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16a00/0x5e4fb0a8aa199a70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1e3 expref: 62 pid: 6579 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756274.611707:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:2.0:1782756274.611712:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199a7e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756274.611732:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199a7e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756274.611738:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756274.611792:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c501d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+62:2356:x1869355210071936:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 140us (3070us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756274.611800:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 81 00000100:00100000:1.0:1782756274.617220:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756274.617563:0:8367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210072320 00000100:00100000:2.0:1782756274.617576:0:8367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210072320 00010000:00010000:2.0:1782756274.617631:0:8367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16c00/0x5e4fb0a8aa199a46 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1d5 expref: 62 pid: 5805 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756274.617685:0:8367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 82 00000100:00100000:2.0:1782756274.617697:0:8367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76e0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26487635-60cb-4aee-af8e-396654f6c3d8+62:2355:x1869355210072320:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782756274.617715:0:8367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756274.617723:0:8367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16c00/0x5e4fb0a8aa199a46 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1d5 expref: 62 pid: 5805 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756274.617736:0:8367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16c00/0x5e4fb0a8aa199a46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1d5 expref: 62 pid: 5805 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756274.617764:0:8367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:2.0:1782756274.617770:0:8367:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199a7e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756274.617781:0:8367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199a7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756274.617813:0:8367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199a7e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756274.617841:0:8367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756274.618142:0:8367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76e0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26487635-60cb-4aee-af8e-396654f6c3d8+62:2355:x1869355210072320:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 444us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756274.618150:0:8367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 82 00010000:00010000:3.0:1782756274.618740:0:5805:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.25@tcp) returned -22 from blocking AST (req@00000000d0198d3e x1869355222636032) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16a00/0x5e4fb0a8aa199a70 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1e3 expref: 61 pid: 6579 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.618763:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16a00/0x5e4fb0a8aa199a70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1e3 expref: 61 pid: 6579 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756274.618784:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7ff37b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869355222636032:192.168.204.25@tcp:104: 00010000:00010000:3.0:1782756274.618802:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16c00/0x5e4fb0a8aa199a46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1d5 expref: 60 pid: 5805 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756274.618813:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76d7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869355222636160:192.168.204.25@tcp:104: 00010000:00010000:3.0:1782756274.618841:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:3.0:1782756274.618995:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199a7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.619024:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199a7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.619032:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199a7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782756274.619071:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1782756274.619362:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199a77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1ea expref: 61 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.619383:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199a7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1ea expref: 60 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756274.619391:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:3.0:1782756274.619394:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782756274.619411:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168ca00, rc 0) 00000100:00100000:3.0:1782756274.619497:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76e0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+60:11591:x1869355210072192:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 10351us (10648us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1782756274.619506:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 212 00000100:00100000:1.0:1782756274.622459:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756274.623751:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210072576 00000100:00100000:3.0:1782756274.623772:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210072576 00000100:00100000:2.0:1782756274.624048:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16 00000100:00100000:2.0:1782756274.624100:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76e0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26487635-60cb-4aee-af8e-396654f6c3d8+60:11591:x1869355210072576:12345-192.168.204.25@tcp:103:lfs.0 00010000:00010000:2.0:1782756274.624127:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756274.624160:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16600/0x5e4fb0a8aa1999dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1c0 expref: 60 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756274.624187:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:2.0:1782756274.624193:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756274.624301:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76e0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26487635-60cb-4aee-af8e-396654f6c3d8+59:11591:x1869355210072576:12345-192.168.204.25@tcp:103:lfs.0 Request processed in 229us (1856us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756274.624310:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16 00000100:00100000:0.0:1782756274.627395:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756274.627588:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210072704 00000100:00100000:1.0:1782756274.627601:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210072704 00000100:00100000:1.0:1782756274.627677:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 213 00000100:00100000:1.0:1782756274.627687:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+59:11591:x1869355210072704:12345-192.168.204.25@tcp:58:lfs.0 00010000:00010000:1.0:1782756274.627850:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199a8c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.627872:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199a8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756274.627886:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199a8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782756274.628191:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1782756274.628299:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+59:11591:x1869355210072704:12345-192.168.204.25@tcp:58:lfs.0 Request processed in 612us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756274.628310:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 213 00000100:00100000:1.0:1782756274.631218:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756274.631335:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210072832 00000100:00100000:0.0:1782756274.631360:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210072832 00000100:00100000:0.0:1782756274.631438:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 214 00000100:00100000:0.0:1782756274.631464:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76e0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+59:11591:x1869355210072832:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1782756274.631492:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756274.631519:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16400/0x5e4fb0a8aa199a93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce1f1 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.631595:0:6579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199a8c lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.631609:0:6579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16400/0x5e4fb0a8aa199a93 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1f1 expref: 60 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.631634:0:6579:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199a8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.631673:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16400/0x5e4fb0a8aa199a93 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1f1 expref: 60 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.631690:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:0.0:1782756274.631693:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782756274.631698:0:6579:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16400/0x5e4fb0a8aa199a93 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1f1 expref: 60 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756274.631705:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c76e16400, rc 0) 00000100:00100000:0.0:1782756274.631777:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76e0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+60:11591:x1869355210072832:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 328us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756274.631785:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 214 00010000:00010000:3.0:1782756274.636243:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782756275.277234:0:11537:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782756275.277245:0:11537:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782756275.277287:0:11537:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1782756275.277294:0:11537:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782756275.277421:0:11537:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419f9f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11537:1869355222636288:192.168.204.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782756275.277537:0:11537:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78a506c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782756275.284392:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756275.284666:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210072960 00000100:00100000:3.0:1782756275.284682:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210072960 00000100:00100000:0.0:1782756275.284699:0:11537:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419f9f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11537:1869355222636288:192.168.204.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782756275.284791:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 215 00000100:00100000:3.0:1782756275.284805:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76e0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+60:11592:x1869355210072960:12345-192.168.204.25@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782756275.284846:0:5805:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782756275.285015:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76e0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+60:11592:x1869355210072960:12345-192.168.204.25@tcp:53:lhsmtool_posix.0 Request processed in 212us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756275.285023:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 215 00000100:00080000:2.0:1782756275.285196:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782756275.290686:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756275.290900:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210073088 00000100:00100000:3.0:1782756275.290975:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210073088 00000100:00100000:3.0:1782756275.291068:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 216 00000100:00100000:3.0:1782756275.291119:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+60:11592:x1869355210073088:12345-192.168.204.25@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1782756275.291215:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199a9a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.291235:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199a9a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.291251:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199a9a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.294280:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199aa1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.294304:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.294317:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.294350:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199aa8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.294359:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.294366:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782756275.294426:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1782756275.294430:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782756275.294442:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.294453:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199a9a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.294460:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199a9a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.294466:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199a9a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.294472:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168c400 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756275.294476:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199a9a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.294483:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199a9a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.294496:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3c54288100) 00010000:00010000:3.0:1782756275.294499:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756275.294503:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199a9a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.294509:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c400/0x5e4fb0a8aa199a9a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.294524:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.294541:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199aa1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.294547:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199aa1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.294552:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168d200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756275.294555:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199aa1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.294560:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199aa1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.294567:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9d3c49e15500) 00010000:00010000:3.0:1782756275.294569:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756275.294572:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199aa1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.294578:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199aa1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.294596:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.294602:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199aa8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.294607:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199aa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.294613:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168cc00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756275.294621:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199aa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.294628:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199aa8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.294636:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:3.0:1782756275.294638:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756275.294640:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199aa8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.294645:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199aa8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756275.296111:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+60:11592:x1869355210073088:12345-192.168.204.25@tcp:34:lhsmtool_posix.0 Request processed in 5025us (5431us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756275.296125:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 216 00000100:00100000:0.0:1782756275.304364:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756275.304483:0:11978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210073344 00000100:00100000:1.0:1782756275.304518:0:11978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210073344 00000100:00100000:1.0:1782756275.304604:0:11978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 217 00000100:00100000:1.0:1782756275.304618:0:11978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+60:11592:x1869355210073344:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782756275.304646:0:11978:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756275.304672:0:11978:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa199aaf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce1f8 expref: -99 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756275.304803:0:11978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa199ab6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756275.304821:0:11978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa199ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756275.304835:0:11978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa199ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756275.304848:0:11978:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1782756275.305148:0:11978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa199ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756275.305158:0:11978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa199ab6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756275.305166:0:11978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa199ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756275.305175:0:11978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5a00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756275.305182:0:11978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa199ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756275.305190:0:11978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa199ab6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756275.305218:0:11978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:1.0:1782756275.305221:0:11978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782756275.305226:0:11978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa199ab6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756275.305233:0:11978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5a00/0x5e4fb0a8aa199ab6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756275.305281:0:11978:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa199aaf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1f8 expref: 62 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756275.305293:0:11978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3c54288100) 00010000:00010000:1.0:1782756275.305310:0:11978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782756275.305315:0:11978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4600/0x5e4fb0a8aa199aaf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1f8 expref: 62 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756275.305327:0:11978:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef4600, rc 0) 00000100:00100000:1.0:1782756275.305584:0:11978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+61:11592:x1869355210073344:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 969us (1228us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1782756275.305593:0:11978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 217 00000100:00100000:1.0:1782756275.310785:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756275.311069:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210073472 00000100:00100000:0.0:1782756275.311128:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210073472 00000100:00100000:0.0:1782756275.311193:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 218 00000100:00100000:0.0:1782756275.311205:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76e0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+61:11592:x1869355210073472:12345-192.168.204.25@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782756275.311257:0:5803:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782756275.311743:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76e0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+61:11592:x1869355210073472:12345-192.168.204.25@tcp:53:lhsmtool_posix.0 Request processed in 538us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756275.311753:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 218 00000100:00100000:2.0:1782756275.317577:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756275.317935:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210073728 00000100:00100000:0.0:1782756275.317948:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210073728 00000100:00100000:0.0:1782756275.318031:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 219 00000100:00100000:0.0:1782756275.318055:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7ff37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+61:11592:x1869355210073728:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782756275.318128:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756275.318132:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782756275.318168:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199a54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1dc expref: 61 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.318192:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:0.0:1782756275.318197:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782756275.318213:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa199ac4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce1ff expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782756275.318911:0:5804:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:0.0:1782756275.319219:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16600/0x5e4fb0a8aa199acb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.319237:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16600/0x5e4fb0a8aa199acb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.319250:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16600/0x5e4fb0a8aa199acb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.319316:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa199ac4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1ff expref: 63 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.320784:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16600/0x5e4fb0a8aa199acb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1ff expref: 62 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.320796:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d3c54288e00) 00010000:00010000:0.0:1782756275.320800:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782756275.320804:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c76e16600, rc 0) 00000100:00100000:0.0:1782756275.320903:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7ff37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+62:11592:x1869355210073728:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 2860us (3340us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1782756275.320914:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 219 00000100:00100000:1.0:1782756275.324944:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756275.325198:0:11978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210073984 00000100:00100000:3.0:1782756275.325212:0:11978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210073984 00000100:00100000:3.0:1782756275.325366:0:11978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 220 00000100:00100000:3.0:1782756275.325381:0:11978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+62:11592:x1869355210073984:12345-192.168.204.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782756275.325466:0:11978:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756275.325502:0:11978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16600/0x5e4fb0a8aa199acb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1ff expref: 62 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.325527:0:11978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d3c54288e00) 00010000:00010000:3.0:1782756275.325540:0:11978:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782756275.325565:0:11978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199ad9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.325615:0:11978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199ad9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.325627:0:11978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199ad9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.325644:0:11978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199ae0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xb2149f91 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.325652:0:11978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199ae0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb2149f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.325659:0:11978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199ae0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb2149f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.325763:0:11978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199ad9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.325771:0:11978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199ad9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.325779:0:11978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199ad9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.325785:0:11978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168cc00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756275.325791:0:11978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199ad9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.325800:0:11978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199ad9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.325809:0:11978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:3.0:1782756275.325819:0:11978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756275.325824:0:11978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199ad9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.325831:0:11978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168cc00/0x5e4fb0a8aa199ad9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.325842:0:11978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199ae0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb2149f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.325848:0:11978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199ae0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb2149f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.325854:0:11978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199ae0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb2149f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.325859:0:11978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168d200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756275.325862:0:11978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199ae0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb2149f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.325869:0:11978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199ae0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb2149f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.325876:0:11978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xb2149f91 (ffff9d3c49e15500) 00010000:00010000:3.0:1782756275.325879:0:11978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756275.325882:0:11978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199ae0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb2149f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.325888:0:11978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199ae0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb2149f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756275.325997:0:11978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+61:11592:x1869355210073984:12345-192.168.204.25@tcp:36:lhsmtool_posix.0 Request processed in 619us (1064us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782756275.326011:0:11978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 220 00000100:00100000:1.0:1782756275.330061:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756275.330275:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210074112 00000100:00100000:0.0:1782756275.330292:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210074112 00000100:00100000:0.0:1782756275.330371:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 221 00000100:00100000:0.0:1782756275.330383:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+61:11592:x1869355210074112:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782756275.330421:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756275.330458:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa199ae7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce206 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.330505:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199aee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.330521:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199aee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.330534:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199aee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.330712:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa199ae7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce206 expref: 63 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.330749:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199aee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce206 expref: 62 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.330759:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d3c54288800) 00010000:00010000:0.0:1782756275.330762:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782756275.330765:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c76e17600, rc 0) 00000100:00100000:0.0:1782756275.332423:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+62:11592:x1869355210074112:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 2030us (2371us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756275.332437:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 221 00000100:00100000:1.0:1782756275.337850:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756275.337957:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210074368 00000100:00100000:0.0:1782756275.337968:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210074368 00000100:00100000:0.0:1782756275.338174:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 222 00000100:00100000:0.0:1782756275.338187:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76e0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+62:11592:x1869355210074368:12345-192.168.204.25@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782756275.338306:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa199af5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.338325:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa199af5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.338339:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa199af5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782756275.339308:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1782756275.339322:0:5804:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 316574246104ns, next at 317574243211ns, rc = 0 00000004:00010000:0.0:1782756275.339439:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000070185355 reply state 0000000089dcb963 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa199af5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756275.339486:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782756275.339626:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76e0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+64:11592:x1869355210074368:12345-192.168.204.25@tcp:36:lhsmtool_posix.0 Request processed in 1438us (1787us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1782756275.339635:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 222 00010000:00010000:3.0:1782756275.341525:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa199af5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.341541:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa199af5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.341549:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa199af5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.341554:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c76e17000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756275.341560:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa199af5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.341568:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa199af5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.341591:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d3c54288800) 00010000:00010000:3.0:1782756275.341595:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782756275.341601:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa199af5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.341608:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa199af5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756275.344589:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756275.345062:0:11978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210074496 00000100:00100000:3.0:1782756275.345108:0:11978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210074496 00000100:00100000:3.0:1782756275.345183:0:11978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 223 00000100:00100000:3.0:1782756275.345195:0:11978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76e0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+63:11592:x1869355210074496:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782756275.345226:0:11978:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756275.345271:0:11978:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199afc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce20d expref: -99 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.345348:0:11978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199afc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce20d expref: 64 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.345365:0:11978:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199afc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce20d expref: 64 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.345387:0:11978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d3c54288800) 00010000:00010000:3.0:1782756275.345391:0:11978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782756275.345394:0:11978:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168d200, rc 0) 00000100:00100000:3.0:1782756275.345480:0:11978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76e0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+64:11592:x1869355210074496:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 286us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756275.345487:0:11978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 223 00000100:00100000:1.0:1782756275.347752:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756275.347860:0:10416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210074624 00000100:00100000:0.0:1782756275.347872:0:10416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210074624 00000100:00080000:2.0:1782756275.347987:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782756275.348068:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 63 00000100:00100000:0.0:1782756275.348122:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76e0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+9:2356:x1869355210074624:12345-192.168.204.25@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1782756275.348696:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76e0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+10:2356:x1869355210074624:12345-192.168.204.25@tcp:2:lhsmtool_posix.0 Request processed in 572us (1001us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1782756275.348705:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 63 00000100:00100000:0.0:1782756275.355969:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756275.356173:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210074880 00000100:00100000:2.0:1782756275.356185:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210074880 00000100:00100000:2.0:1782756275.356265:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 60 00000100:00100000:2.0:1782756275.356278:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+64:11592:x1869355210074880:12345-192.168.204.25@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1782756275.357219:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+65:11592:x1869355210074880:12345-192.168.204.25@tcp:35:lhsmtool_posix.0 Request processed in 940us (1261us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1782756275.357231:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 60 00000100:00100000:1.0:1782756275.359883:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756275.360287:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210075136 00000100:00100000:0.0:1782756275.360298:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210075136 00000100:00100000:0.0:1782756275.360443:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 224 00000100:00100000:0.0:1782756275.360468:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+65:11592:x1869355210075136:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782756275.360608:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+65:11592:x1869355210075136:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 Request processed in 142us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756275.360617:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 224 00000100:00100000:1.0:1782756275.362934:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756275.363030:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210075264 00000100:00100000:2.0:1782756275.363050:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210075264 00000100:00100000:2.0:1782756275.363156:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 225 00000100:00100000:2.0:1782756275.363167:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+65:11592:x1869355210075264:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782756275.363194:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756275.363219:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa199b03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce214 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.363309:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa199b0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.363327:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa199b0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.363352:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa199b0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756275.363400:0:6579:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782756275.363424:0:6579:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa199b0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.363630:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa199b03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce214 expref: 67 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.363656:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa199b0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce214 expref: 66 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.363682:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d3c54288800) 00010000:00010000:2.0:1782756275.363685:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1782756275.363690:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63de00, rc 0) 00000100:00100000:2.0:1782756275.363766:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+66:11592:x1869355210075264:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 601us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756275.363774:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 225 00000100:00100000:1.0:1782756275.366537:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756275.366650:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210075392 00000100:00100000:2.0:1782756275.366662:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210075392 00000100:00100000:2.0:1782756275.366767:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 64 00000100:00100000:2.0:1782756275.366779:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+10:2356:x1869355210075392:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782756275.366802:0:6602:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756275.366828:0:6602:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199b11 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce21b expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782756275.366865:0:6602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a42b3b2, blocks: 0x1 00010000:00010000:2.0:1782756275.366893:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=316s v=(0 0) 00010000:00010000:2.0:1782756275.366899:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756275.366921:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199b11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce21b expref: 11 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.366945:0:6602:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199b11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce21b expref: 11 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.366961:0:6602:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63d200, rc 0) 00000100:00100000:2.0:1782756275.367061:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+11:2356:x1869355210075392:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 284us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756275.367069:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 64 00000100:00100000:1.0:1782756275.369597:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756275.369693:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210075648 00000100:00100000:3.0:1782756275.369705:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210075648 00000100:00100000:3.0:1782756275.369777:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 226 00000100:00100000:3.0:1782756275.369789:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+66:11592:x1869355210075648:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1782756275.369930:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+66:11592:x1869355210075648:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 Request processed in 143us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756275.369939:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 226 00000100:00100000:0.0:1782756275.372736:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756275.372844:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210075776 00000100:00100000:3.0:1782756275.372855:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210075776 00000100:00100000:3.0:1782756275.372951:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 65 00000100:00100000:3.0:1782756275.372963:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+11:11592:x1869355210075776:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782756275.372985:0:6603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756275.373025:0:6603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a4be169/0x5e4fb0a8aa199b18 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce222 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.373138:0:6603:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199b11 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce21b expref: 12 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.373153:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756275.373158:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756275.373164:0:6603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a4be169/0x5e4fb0a8aa199b18 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce222 expref: 12 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.373289:0:6603:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199b11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce21b expref: 12 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.373305:0:6603:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199b11 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce21b expref: 12 pid: 6602 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756275.373323:0:6603:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7ff34e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6603:1869355222636416:192.168.204.25@tcp:104: 00000100:00100000:2.0:1782756275.373574:0:6603:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76d17e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782756275.375843:0:6603:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7ff34e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6603:1869355222636416:192.168.204.25@tcp:104: 00010000:00010000:2.0:1782756275.375874:0:6603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a4be169/0x5e4fb0a8aa199b18 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce222 expref: 12 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.375893:0:6603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168cc00, rc 0) 00000100:00100000:2.0:1782756275.375952:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+12:11592:x1869355210075776:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 2990us (3226us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756275.375963:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 65 00000100:00100000:1.0:1782756275.376826:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756275.377017:0:8367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210075904 00000100:00100000:2.0:1782756275.377026:0:8367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210075904 00010000:00010000:2.0:1782756275.377128:0:8367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199b11 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce21b expref: 12 pid: 6602 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756275.377163:0:8367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 83 00000100:00100000:2.0:1782756275.377174:0:8367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26487635-60cb-4aee-af8e-396654f6c3d8+12:2355:x1869355210075904:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782756275.377213:0:8367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756275.377240:0:8367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199b11 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce21b expref: 12 pid: 6602 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.377268:0:8367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199b11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce21b expref: 12 pid: 6602 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.377296:0:8367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199b11 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce21b expref: 12 pid: 6602 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.377315:0:8367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756275.377320:0:8367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756275.377330:0:8367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a4be169/0x5e4fb0a8aa199b18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce222 expref: 11 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.377351:0:8367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a4be169/0x5e4fb0a8aa199b18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce222 expref: 11 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.377397:0:8367:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009a4be169/0x5e4fb0a8aa199b18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce222 expref: 11 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756275.377414:0:8367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7ff34e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8367:1869355222636544:192.168.204.25@tcp:105: 00000100:00100000:2.0:1782756275.377514:0:8367:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76d17e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782756275.379364:0:8367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7ff34e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8367:1869355222636544:192.168.204.25@tcp:105: 00010000:00010000:2.0:1782756275.379387:0:8367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756275.379733:0:8367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26487635-60cb-4aee-af8e-396654f6c3d8+11:2355:x1869355210075904:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2559us (2909us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756275.379743:0:8367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 83 00000100:00100000:1.0:1782756275.381801:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756275.382173:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210076032 00000100:00100000:0.0:1782756275.382185:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210076032 00002000:00100000:0.0:1782756275.382257:0:6609:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9d3c78e59500 x1869355210076032/t0(0) o4->26487635-60cb-4aee-af8e-396654f6c3d8@192.168.204.25@tcp:456/0 lens 504/0 e 0 to 0 dl 1782756286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782756275.382295:0:6609:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3c78e59500 with x1869355210076032 ext(0->12) 00002000:00010000:0.0:1782756275.382303:0:6609:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d3c78e59500 00000100:00100000:0.0:1782756275.382342:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7 00000100:00100000:0.0:1782756275.382353:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26487635-60cb-4aee-af8e-396654f6c3d8+11:2356:x1869355210076032:12345-192.168.204.25@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1782756275.384227:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26487635-60cb-4aee-af8e-396654f6c3d8+13:2356:x1869355210076032:12345-192.168.204.25@tcp:4:lhsmtool_posix.0 Request processed in 1863us (2420us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1782756275.384242:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7 00002000:00100000:0.0:1782756275.384267:0:6609:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9d3c78e59500 x1869355210076032/t4294967320(0) o4->26487635-60cb-4aee-af8e-396654f6c3d8@192.168.204.25@tcp:456/0 lens 504/448 e 0 to 0 dl 1782756286 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782756275.384277:0:6609:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3c78e59500 with x1869355210076032 ext(0->12) 00002000:00010000:0.0:1782756275.384284:0:6609:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d3c78e59500 00000100:00100000:1.0:1782756275.387996:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756275.388128:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210076160 00000100:00100000:0.0:1782756275.388141:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210076160 00000100:00100000:0.0:1782756275.388217:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 227 00000100:00100000:0.0:1782756275.388229:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+66:11592:x1869355210076160:12345-192.168.204.25@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1782756275.417189:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:1.0:1782756275.417208:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:1.0:1782756275.417256:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1782756275.417278:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d3c78a50f00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1782756275.417284:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d3c7fb90300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d3c78a50d80 00000020:00080000:1.0:1782756275.417288:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d3c7fb90400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d3c76e11400 00000004:00080000:1.0:1782756275.417314:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000001:00080000:1.0:1782756275.417367:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:1.0:1782756275.417403:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d3c76fc8780 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1782756275.417407:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d3c7fbe6000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d3c76fc89c0 00000020:00080000:1.0:1782756275.417410:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d3c7fbe6400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d3c76d9e000 00000020:00080000:1.0:1782756275.417576:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1782756275.417792:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1782756275.417890:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222636672:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782756275.418071:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756275.418330:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222636672 00000100:00100000:1.0:1782756275.418340:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222636672 00000100:00100000:1.0:1782756275.418407:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782756275.418418:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3314:x1869355222636672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782756275.418454:0:6605:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:1.0:1782756275.418516:0:6605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a42b3b1, atime: 0x6a42b3b1, ctime: 0x6a42b3b1, blocks: 0x1 00010000:00010000:1.0:1782756275.418527:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b9cfd33/0x5e4fb0a8aa199b1f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756275.418547:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=316s v=(0 0) 00010000:00010000:1.0:1782756275.418552:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756275.418560:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b9cfd33/0x5e4fb0a8aa199b1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756275.418578:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b9cfd33/0x5e4fb0a8aa199b1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756275.418590:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b9cfd33/0x5e4fb0a8aa199b1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756275.418599:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b9cfd33/0x5e4fb0a8aa199b1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756275.418620:0:6605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782756275.419231:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782756275.419242:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b9cfd33/0x5e4fb0a8aa199b1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.419253:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5200 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:2.0:1782756275.419259:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b9cfd33/0x5e4fb0a8aa199b1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.419270:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b9cfd33/0x5e4fb0a8aa199b1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.419291:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b9cfd33/0x5e4fb0a8aa199b1f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.419298:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b9cfd33/0x5e4fb0a8aa199b1f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.419322:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756275.419324:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756275.419326:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782756275.419340:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782756275.419357:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c76d7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222636800:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782756275.419420:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756275.419977:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3314:x1869355222636672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1559us (1905us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1782756275.419988:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782756275.420185:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+20:11592:x1869355210076160:12345-192.168.204.25@tcp:44:lhsmtool_posix.0 Request processed in 31956us (32201us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756275.420196:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 227 00000100:00100000:0.0:1782756275.420238:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c770fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222636928:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1782756275.420447:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756275.420501:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222636800 00000100:00100000:1.0:1782756275.420511:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222636800 00000100:00080000:2.0:1782756275.420582:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782756275.420645:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782756275.420659:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7ff34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3315:x1869355222636800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1782756275.420692:0:10416:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1782756275.420721:0:10416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009906f227/0x5e4fb0a8aa199b26 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.420743:0:10416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7380b48/0x5e4fb0a8aa1998e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce181 expref: 12 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.420752:0:10416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1782756275.420756:0:10416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782756275.420762:0:10416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009906f227/0x5e4fb0a8aa199b26 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.420797:0:10416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d7380b48/0x5e4fb0a8aa1998e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce181 expref: 12 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.420828:0:10416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d7380b48/0x5e4fb0a8aa1998e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce181 expref: 12 pid: 10416 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756275.420842:0:10416:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c770fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10416:1869355222637056:192.168.204.25@tcp:104: 00000100:00100000:3.0:1782756275.420894:0:10416:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78a01c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782756275.420985:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222636928 00000100:00100000:2.0:1782756275.420991:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222636928 00000100:00100000:1.0:1782756275.421092:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782756275.421103:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3316:x1869355222636928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1782756275.421255:0:6605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1782756275.421264:0:6605:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1782756274 00002000:00010000:1.0:1782756275.421267:0:6605:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1782756275.421270:0:6605:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1782756274 -> 1782756274 00002000:00010000:1.0:1782756275.421272:0:6605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1782756275.421319:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3316:x1869355222636928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 219us (873us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1782756275.421327:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:0.0:1782756275.421403:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d3c770fc700/2, rc 0, transno 4294967321 00000100:00100000:0.0:1782756275.421411:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c770fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222636928:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1782756275.421526:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d3c78e59880/2, rc 0, transno 4294967310 00000100:00100000:1.0:1782756275.421532:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222636672:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782756275.424387:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756275.424428:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756275.424465:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210076416 00000100:00100000:1.0:1782756275.424475:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210076416 00010000:00010000:1.0:1782756275.424527:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d7380b48/0x5e4fb0a8aa1998e1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce181 expref: 13 pid: 10416 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756275.424574:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 84 00000100:00100000:1.0:1782756275.424586:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+13:2355:x1869355210076416:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782756275.424605:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756275.424611:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d7380b48/0x5e4fb0a8aa1998e1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce181 expref: 13 pid: 10416 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756275.424627:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d7380b48/0x5e4fb0a8aa1998e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce181 expref: 13 pid: 10416 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756275.424660:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782756275.424683:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782756275.424690:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009906f227/0x5e4fb0a8aa199b26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756275.424704:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009906f227/0x5e4fb0a8aa199b26 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756275.424730:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756275.424756:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210076288 00000100:00100000:2.0:1782756275.424763:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210076288 00000100:00100000:1.0:1782756275.424794:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+14:2355:x1869355210076416:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 209us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756275.424806:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 69 00000100:00100000:2.0:1782756275.424816:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+14:2355:x1869355210076288:12345-192.168.204.25@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1782756275.424825:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 84 00010000:00010000:3.0:1782756275.427230:0:10416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7380b48/0x5e4fb0a8aa1998e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce181 expref: 13 pid: 10416 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756275.427260:0:10416:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c770fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10416:1869355222637056:192.168.204.25@tcp:104: 00010000:00010000:3.0:1782756275.427292:0:10416:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009906f227/0x5e4fb0a8aa199b26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.427305:0:10416:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009906f227/0x5e4fb0a8aa199b26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.427313:0:10416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009906f227/0x5e4fb0a8aa199b26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.427326:0:10416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009906f227/0x5e4fb0a8aa199b26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.427335:0:10416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009906f227/0x5e4fb0a8aa199b26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.431132:0:10416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782756275.431729:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7ff34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3315:x1869355222636800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11068us (12302us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1782756275.431742:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:3.0:1782756275.431785:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756275.431793:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009906f227/0x5e4fb0a8aa199b26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.431805:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168c400 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756275.431810:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009906f227/0x5e4fb0a8aa199b26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.431823:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009906f227/0x5e4fb0a8aa199b26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.431848:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009906f227/0x5e4fb0a8aa199b26 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.431856:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009906f227/0x5e4fb0a8aa199b26 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.431880:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756275.431882:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756275.431884:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782756275.434444:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d3c76d7b100/2, rc 0, transno 4294967322 00000100:00100000:3.0:1782756275.434463:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c76d7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222636800:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782756275.453183:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+12:2355:x1869355210076288:12345-192.168.204.25@tcp:16:lhsmtool_posix.0 Request processed in 28353us (28795us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756275.453198:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 69 00000001:00080000:0.0:1782756275.453274:0:6627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:0.0:1782756275.453293:0:6627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:0.0:1782756275.453300:0:6627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:1.0:1782756275.455654:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756275.455779:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210076672 00000100:00100000:2.0:1782756275.455790:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210076672 00000100:00100000:2.0:1782756275.455896:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 228 00000100:00100000:2.0:1782756275.455906:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+20:11592:x1869355210076672:12345-192.168.204.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782756275.455969:0:6579:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756275.455998:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63de00/0x5e4fb0a8aa199b0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce214 expref: 20 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.456018:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d3c54288800) 00010000:00010000:2.0:1782756275.456022:0:6579:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782756275.456125:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa199b2d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.456139:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa199b2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.456148:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa199b2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782756275.456451:0:6579:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000099f6381d reply state 000000006efcfe45 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa199b2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756275.456632:0:6579:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782756275.456767:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+21:11592:x1869355210076672:12345-192.168.204.25@tcp:36:lhsmtool_posix.0 Request processed in 860us (1124us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1782756275.456775:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 228 00010000:00010000:1.0:1782756275.461145:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa199b2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756275.461168:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa199b2d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756275.461178:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa199b2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756275.461185:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756275.461191:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa199b2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756275.461199:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa199b2d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756275.461220:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d3c54288800) 00010000:00010000:1.0:1782756275.461224:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756275.461246:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa199b2d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756275.461253:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa199b2d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756275.461766:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756275.461857:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210076800 00000100:00100000:2.0:1782756275.461866:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210076800 00000100:00100000:2.0:1782756275.461967:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 70 00000100:00100000:2.0:1782756275.461976:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+7:2355:x1869355210076800:12345-192.168.204.25@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1782756275.462240:0:6605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1782756275.462244:0:6605:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1782756274 -> 1782756274 00002000:00010000:2.0:1782756275.462247:0:6605:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1782756273 00002000:00010000:2.0:1782756275.462250:0:6605:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1782756274 -> 1782756274 00002000:00010000:2.0:1782756275.462253:0:6605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1782756275.462310:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26487635-60cb-4aee-af8e-396654f6c3d8+8:2355:x1869355210076800:12345-192.168.204.25@tcp:2:lhsmtool_posix.0 Request processed in 335us (546us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1782756275.462318:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 70 00000100:00100000:3.0:1782756275.467630:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756275.468196:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210077056 00000100:00100000:0.0:1782756275.468212:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210077056 00000100:00100000:0.0:1782756275.468283:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 229 00000100:00100000:0.0:1782756275.468294:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+20:11592:x1869355210077056:12345-192.168.204.25@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1782756275.468366:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16800/0x5e4fb0a8aa199b34 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.468397:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199aee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce206 expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.468407:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16800/0x5e4fb0a8aa199b34 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.468442:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199aee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce206 expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.468461:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199aee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce206 expref: 20 pid: 5803 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756275.468476:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1869355222637184:192.168.204.25@tcp:104: 00000100:00100000:0.0:1782756275.468604:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c50115600 going to sleep for 11 seconds 00000100:00100000:1.0:1782756275.472511:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756275.472701:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210077184 00000100:00100000:2.0:1782756275.472711:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210077184 00010000:00010000:2.0:1782756275.472751:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199aee lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce206 expref: 21 pid: 5803 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756275.472798:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 85 00000100:00100000:2.0:1782756275.472808:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+21:2355:x1869355210077184:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782756275.472832:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756275.472840:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199aee lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce206 expref: 21 pid: 5803 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.472868:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199aee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce206 expref: 21 pid: 5803 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.472893:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d3c54288800) 00010000:00010000:2.0:1782756275.472899:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16800/0x5e4fb0a8aa199b34 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.472909:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16800/0x5e4fb0a8aa199b34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.472917:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16800/0x5e4fb0a8aa199b34 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.472937:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756275.472999:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+21:2355:x1869355210077184:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 192us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756275.473007:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 85 00010000:00010000:0.0:1782756275.473507:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199aee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce206 expref: 20 pid: 5803 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756275.473526:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1869355222637184:192.168.204.25@tcp:104: 00010000:00010000:0.0:1782756275.473558:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16800/0x5e4fb0a8aa199b34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.473568:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16800/0x5e4fb0a8aa199b34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.473573:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16800/0x5e4fb0a8aa199b34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.473608:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16800/0x5e4fb0a8aa199b34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.473616:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16800/0x5e4fb0a8aa199b34 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.473623:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16800/0x5e4fb0a8aa199b34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.473629:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c76e16800 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756275.473633:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16800/0x5e4fb0a8aa199b34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.473640:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16800/0x5e4fb0a8aa199b34 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.473651:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d3c54288800) 00010000:00010000:0.0:1782756275.473654:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1782756275.473657:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16800/0x5e4fb0a8aa199b34 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.473663:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16800/0x5e4fb0a8aa199b34 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756275.473730:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+19:11592:x1869355210077056:12345-192.168.204.25@tcp:55:lhsmtool_posix.0 Request processed in 5437us (6113us total) trans 0 rc -22/-22 00000100:00100000:0.0:1782756275.473739:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 229 00000100:00100000:1.0:1782756275.477281:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756275.477488:0:10416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210077312 00000100:00100000:3.0:1782756275.477501:0:10416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210077312 00000100:00100000:3.0:1782756275.477571:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 71 00000100:00100000:3.0:1782756275.477584:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+8:2356:x1869355210077312:12345-192.168.204.25@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1782756275.477646:0:10416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009906f227/0x5e4fb0a8aa199b3b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.477672:0:10416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a4be169/0x5e4fb0a8aa199b18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce222 expref: 8 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.477682:0:10416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756275.477687:0:10416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782756275.477692:0:10416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009906f227/0x5e4fb0a8aa199b3b lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.477749:0:10416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009a4be169/0x5e4fb0a8aa199b18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce222 expref: 8 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.477766:0:10416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009a4be169/0x5e4fb0a8aa199b18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce222 expref: 8 pid: 6603 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756275.477785:0:10416:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c770ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10416:1869355222637312:192.168.204.25@tcp:104: 00000100:00100000:3.0:1782756275.477897:0:10416:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78a01900 going to sleep for 11 seconds 00000100:00100000:3.0:1782756275.480929:0:10416:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c770ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10416:1869355222637312:192.168.204.25@tcp:104: 00010000:00010000:3.0:1782756275.480967:0:10416:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009906f227/0x5e4fb0a8aa199b3b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756275.481554:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756275.481660:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210077440 00000100:00100000:0.0:1782756275.481670:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210077440 00010000:00010000:0.0:1782756275.481804:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009a4be169/0x5e4fb0a8aa199b18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce222 expref: 9 pid: 6603 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756275.481851:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 86 00000100:00100000:0.0:1782756275.481862:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+9:2356:x1869355210077440:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782756275.481881:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756275.481912:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009a4be169/0x5e4fb0a8aa199b18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce222 expref: 9 pid: 6603 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.481927:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009a4be169/0x5e4fb0a8aa199b18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce222 expref: 9 pid: 6603 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.481954:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a4be169/0x5e4fb0a8aa199b18 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce222 expref: 9 pid: 6603 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.481975:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782756275.481979:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782756275.481985:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009906f227/0x5e4fb0a8aa199b3b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.482023:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009906f227/0x5e4fb0a8aa199b3b lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.482174:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756275.482238:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+8:2356:x1869355210077440:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 376us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756275.482247:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 86 00010000:00010000:3.0:1782756275.483689:0:10416:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009906f227/0x5e4fb0a8aa199b3b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.483926:0:10416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009906f227/0x5e4fb0a8aa199b3b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.484214:0:10416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009906f227/0x5e4fb0a8aa199b3b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.484226:0:10416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009906f227/0x5e4fb0a8aa199b3b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.484236:0:10416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009906f227/0x5e4fb0a8aa199b3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.484244:0:10416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168c400 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:2.0:1782756275.484270:0:10416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009906f227/0x5e4fb0a8aa199b3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.484282:0:10416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009906f227/0x5e4fb0a8aa199b3b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.484305:0:10416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009906f227/0x5e4fb0a8aa199b3b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.484314:0:10416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009906f227/0x5e4fb0a8aa199b3b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756275.484451:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+7:2356:x1869355210077312:12345-192.168.204.25@tcp:1:lhsmtool_posix.0 Request processed in 6865us (7179us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756275.484463:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 71 00000100:00100000:1.0:1782756275.486744:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756275.487519:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210077696 00000100:00100000:0.0:1782756275.487533:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210077696 00000100:00100000:0.0:1782756275.487654:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 230 00000100:00100000:0.0:1782756275.487666:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+19:11592:x1869355210077696:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1782756275.487768:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16800/0x5e4fb0a8aa199b42 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.487791:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16800/0x5e4fb0a8aa199b42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.487806:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16800/0x5e4fb0a8aa199b42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.488123:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199b49 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.488135:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199afc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce20d expref: 20 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.488144:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199b49 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.488200:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199afc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce20d expref: 20 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.488217:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199afc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce20d expref: 20 pid: 11978 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756275.488233:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1869355222637440:192.168.204.25@tcp:104: 00000100:00100000:0.0:1782756275.488634:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c50115600 going to sleep for 11 seconds 00000100:00100000:1.0:1782756275.492682:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756275.492751:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210077824 00000100:00100000:2.0:1782756275.492762:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210077824 00010000:00010000:2.0:1782756275.492817:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199afc lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce20d expref: 21 pid: 11978 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756275.492864:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 87 00000100:00100000:2.0:1782756275.492875:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c501d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+21:2356:x1869355210077824:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782756275.492894:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756275.492907:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199afc lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce20d expref: 21 pid: 11978 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.492923:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199afc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce20d expref: 21 pid: 11978 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.492971:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d3c54288800) 00010000:00010000:2.0:1782756275.492976:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199b49 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.492986:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199b49 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.492994:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199b49 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.493017:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756275.493142:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c501d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+21:2356:x1869355210077824:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 267us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756275.493151:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 87 00010000:00010000:0.0:1782756275.493242:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d200/0x5e4fb0a8aa199afc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce20d expref: 20 pid: 11978 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756275.493266:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1869355222637440:192.168.204.25@tcp:104: 00010000:00010000:0.0:1782756275.493295:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199b49 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.493307:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199b49 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.493314:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199b49 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782756275.493788:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1782756275.494066:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1782756275.494169:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1782756275.494273:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5803:1869355222637568:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782756275.494411:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756275.494450:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c50115540 going to sleep for 11 seconds 00000100:00100000:2.0:1782756275.494478:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222637568 00000100:00100000:2.0:1782756275.494486:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222637568 00000100:00100000:2.0:1782756275.494530:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782756275.494540:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5803:x1869355222637568:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782756275.494626:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5803:x1869355222637568:12345-0@lo:1000:mdt00_000.0 Request processed in 86us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756275.494633:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782756275.494661:0:5803:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:0.0:1782756275.494669:0:5803:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:0.0:1782756275.494690:0:5803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d3c770fc700, transno 4294967321 00000100:00100000:0.0:1782756275.494714:0:5803:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9d3c76d7b100 x1869355222636800/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1782756291 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756275.494726:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5803:1869355222637568:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1782756275.495225:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1782756275.495266:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5803:1869355222637696:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782756275.495290:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756275.495362:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c50115600 going to sleep for 11 seconds 00000100:00100000:1.0:1782756275.495565:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222637696 00000100:00100000:1.0:1782756275.495572:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222637696 00000100:00100000:1.0:1782756275.495604:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782756275.495613:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5803:x1869355222637696:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1782756275.495773:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5803:x1869355222637696:12345-0@lo:1000:mdt00_000.0 Request processed in 162us (482us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1782756275.495778:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782756275.495876:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5803:1869355222637696:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1782756275.495971:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199b49 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.495979:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199b49 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.495985:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199b49 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.495989:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c76e17600 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756275.495993:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199b49 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.496002:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199b49 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.496022:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d3c54288800) 00010000:00010000:0.0:1782756275.496025:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782756275.496054:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199b49 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.496061:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199b49 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.496175:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199a8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.496181:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199a8c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.496185:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199a8c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.496188:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5800 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756275.496190:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199a8c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.496194:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199a8c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.496200:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:0.0:1782756275.496202:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782756275.496207:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16400/0x5e4fb0a8aa199a93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1f1 expref: 23 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.496217:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16400/0x5e4fb0a8aa199a93 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1f1 expref: 23 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.496224:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16400/0x5e4fb0a8aa199a93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1f1 expref: 23 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.496260:0:5803:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16400/0x5e4fb0a8aa199a93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1f1 expref: 23 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756275.496270:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1869355222637824:192.168.204.25@tcp:105: 00000100:00100000:0.0:1782756275.496392:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c50115600 going to sleep for 11 seconds 00000100:00100000:0.0:1782756275.501199:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1869355222637824:192.168.204.25@tcp:105: 00010000:00010000:0.0:1782756275.501241:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199a8c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.501254:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5800/0x5e4fb0a8aa199a8c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.501297:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16000/0x5e4fb0a8aa199b50 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.501314:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16000/0x5e4fb0a8aa199b50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.501340:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16000/0x5e4fb0a8aa199b50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.501359:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16000/0x5e4fb0a8aa199b50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.501367:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16000/0x5e4fb0a8aa199b50 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.501375:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16000/0x5e4fb0a8aa199b50 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.501409:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c76e16000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756275.501415:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16000/0x5e4fb0a8aa199b50 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.501423:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16000/0x5e4fb0a8aa199b50 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.501445:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:0.0:1782756275.501449:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756275.501453:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16000/0x5e4fb0a8aa199b50 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.501460:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16000/0x5e4fb0a8aa199b50 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.501471:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16800/0x5e4fb0a8aa199b42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.501478:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16800/0x5e4fb0a8aa199b42 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.501485:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16800/0x5e4fb0a8aa199b42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.501491:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c76e16800 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756275.501494:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16800/0x5e4fb0a8aa199b42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.501501:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16800/0x5e4fb0a8aa199b42 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.501520:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:0.0:1782756275.501522:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782756275.501526:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16800/0x5e4fb0a8aa199b42 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.501532:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16800/0x5e4fb0a8aa199b42 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756275.501848:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+23:11592:x1869355210077696:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 Request processed in 14181us (15113us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1782756275.501861:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 230 00000020:00080000:0.0:1782756275.501868:0:5803:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1782756275.502394:0:11537:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782756275.502401:0:11537:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782756275.503624:0:11537:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1782756275.503640:0:11537:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782756275.503968:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756275.504028:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210077952 00000100:00100000:0.0:1782756275.504052:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210077952 00000100:00100000:0.0:1782756275.504164:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 61 00000100:00100000:0.0:1782756275.504176:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7ff37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+23:11591:x1869355210077952:12345-192.168.204.25@tcp:49:lfs.0 00000100:00100000:1.0:1782756275.504294:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756275.504337:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:0.0:1782756275.504345:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7ff37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+23:11591:x1869355210077952:12345-192.168.204.25@tcp:49:lfs.0 Request processed in 172us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756275.504347:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:0.0:1782756275.504353:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 61 00000100:00100000:0.0:1782756275.504368:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210078208 00000100:00100000:0.0:1782756275.504371:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210078208 00000100:00100000:0.0:1782756275.504387:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 62 00000100:00100000:0.0:1782756275.504393:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c49779050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+23:11592:x1869355210078208:12345-192.168.204.25@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1782756275.505392:0:5807:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1782756275.505479:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1782756275.505524:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199b57 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.505545:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199b57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.505561:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199b57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.505569:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199b57 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.505574:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199b57 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.505577:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199b57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.505591:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782756275.505617:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782756275.505624:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199b57 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.505642:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c76e17600 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:2.0:1782756275.505653:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199b57 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.505662:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199b57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.505678:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d3c54288800) 00010000:00010000:2.0:1782756275.505682:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782756275.505687:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199b57 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.505694:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199b57 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756275.505713:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756275.505715:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756275.505717:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756275.505728:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c49779050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+25:11592:x1869355210078208:12345-192.168.204.25@tcp:35:lhsmtool_posix.0 Request processed in 1332us (1430us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1782756275.505737:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 62 00000020:00080000:0.0:1782756275.505742:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1782756275.506965:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756275.509827:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210078464 00000100:00100000:2.0:1782756275.509847:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210078464 00000100:00100000:2.0:1782756275.510002:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 231 00000100:00100000:2.0:1782756275.510016:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+25:11591:x1869355210078464:12345-192.168.204.25@tcp:58:lfs.0 00000040:00080000:2.0:1782756275.510441:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1782756275.510918:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+25:11591:x1869355210078464:12345-192.168.204.25@tcp:58:lfs.0 Request processed in 901us (3956us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756275.510928:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 231 00000100:00100000:3.0:1782756275.536497:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756275.536561:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210078592 00000100:00100000:0.0:1782756275.536574:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210078592 00000100:00100000:0.0:1782756275.536658:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 232 00000100:00100000:0.0:1782756275.536671:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+25:11594:x1869355210078592:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1782756275.536707:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756275.536736:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16800/0x5e4fb0a8aa199b5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce229 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.536906:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16000/0x5e4fb0a8aa199b65 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.536945:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16000/0x5e4fb0a8aa199b65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.536960:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16000/0x5e4fb0a8aa199b65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.536980:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17400/0x5e4fb0a8aa199b6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.536987:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17400/0x5e4fb0a8aa199b6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.536995:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17400/0x5e4fb0a8aa199b6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.538763:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199b73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.538790:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199a7e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1ea expref: 26 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.538801:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199b73 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.538863:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199a7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1ea expref: 26 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.538995:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199a7e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1ea expref: 26 pid: 5805 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756275.539029:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1869355222637952:192.168.204.25@tcp:104: 00000100:00100000:0.0:1782756275.539328:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c50115e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782756275.543268:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756275.543366:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210078848 00000100:00100000:2.0:1782756275.543383:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210078848 00000100:00100000:2.0:1782756275.543749:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 63 00000100:00100000:2.0:1782756275.543763:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+27:5578:x1869355210078848:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1782756275.543845:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1869355222637952:192.168.204.25@tcp:104: 00010000:00010000:0.0:1782756275.543882:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199b73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756275.544143:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+28:5578:x1869355210078848:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 382us (883us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1782756275.544170:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 63 00000100:00100000:1.0:1782756275.552016:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756275.552369:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210078976 00000100:00100000:0.0:1782756275.552383:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210078976 00010000:00010000:0.0:1782756275.552451:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199a7e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1ea expref: 28 pid: 5805 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756275.552501:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 88 00000100:00100000:0.0:1782756275.552512:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+28:2356:x1869355210078976:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782756275.552533:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756275.552542:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199a7e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1ea expref: 28 pid: 5805 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.552557:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199a7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1ea expref: 28 pid: 5805 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.552684:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199a7e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1ea expref: 28 pid: 5805 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.552707:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:0.0:1782756275.552713:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199b73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.552741:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199b73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.552751:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199b73 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756275.552790:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756275.552873:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26487635-60cb-4aee-af8e-396654f6c3d8+27:2356:x1869355210078976:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 362us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756275.552883:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 88 00010000:00010000:3.0:1782756275.552964:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199b73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.552974:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199b73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782756275.553032:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1782756275.553046:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782756275.553118:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199b73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.553134:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199b73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.553147:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16000/0x5e4fb0a8aa199b65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.553155:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16000/0x5e4fb0a8aa199b65 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.553162:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16000/0x5e4fb0a8aa199b65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.553184:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c76e16000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756275.553190:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16000/0x5e4fb0a8aa199b65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.553199:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16000/0x5e4fb0a8aa199b65 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.553212:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:3.0:1782756275.553216:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756275.553222:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16000/0x5e4fb0a8aa199b65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.553229:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16000/0x5e4fb0a8aa199b65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.553245:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17400/0x5e4fb0a8aa199b6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.553251:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17400/0x5e4fb0a8aa199b6c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.553258:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17400/0x5e4fb0a8aa199b6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.553264:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c76e17400 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756275.553267:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17400/0x5e4fb0a8aa199b6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.553274:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17400/0x5e4fb0a8aa199b6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.553296:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d3c54288200) 00010000:00010000:3.0:1782756275.553299:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756275.553303:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17400/0x5e4fb0a8aa199b6c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.553310:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17400/0x5e4fb0a8aa199b6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.553358:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16800/0x5e4fb0a8aa199b5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce229 expref: 27 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.553373:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199b73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce229 expref: 26 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756275.553381:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:3.0:1782756275.553384:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782756275.553387:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c76e16200, rc 0) 00000100:00100000:3.0:1782756275.554993:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+26:11594:x1869355210078592:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 18315us (18504us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756275.556713:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 232 00010000:00010000:3.0:1782756275.660202:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782756275.706613:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:0.0:1782756275.706637:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000040:00080000:3.0:1782756276.160008:0:12466:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782756276.160018:0:12466:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782756276.165120:0:12466:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1782756276.165131:0:12466:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1782756276.558280:0:11537:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782756276.558291:0:11537:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782756276.558378:0:11537:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1782756276.558387:0:11537:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782756276.558880:0:11537:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e5b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11537:1869355222638080:192.168.204.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782756276.559283:0:11537:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a4fa3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782756276.564483:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756276.568099:0:11537:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e5b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11537:1869355222638080:192.168.204.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782756276.569615:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210079104 00000100:00100000:0.0:1782756276.569631:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210079104 00000100:00100000:0.0:1782756276.569729:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 233 00000100:00100000:0.0:1782756276.569741:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7ff36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+26:11606:x1869355210079104:12345-192.168.204.25@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782756276.569803:0:5803:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782756276.569982:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7ff36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+26:11606:x1869355210079104:12345-192.168.204.25@tcp:53:lhsmtool_posix.0 Request processed in 241us (5512us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756276.569990:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 233 00000100:00100000:2.0:1782756276.576406:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756276.576704:0:11978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210079360 00000100:00100000:3.0:1782756276.576718:0:11978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210079360 00000100:00100000:3.0:1782756276.576804:0:11978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 234 00000100:00100000:3.0:1782756276.576835:0:11978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7ff37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+26:11606:x1869355210079360:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782756276.576863:0:11978:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756276.576891:0:11978:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199b7a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce230 expref: -99 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756276.577784:0:11978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa199b81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756276.577806:0:11978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa199b81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756276.577833:0:11978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa199b81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756276.577847:0:11978:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1782756276.578351:0:11978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168c200/0x5e4fb0a8aa199b7a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce230 expref: 29 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756276.578378:0:11978:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa199b81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce230 expref: 28 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756276.578464:0:11978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:2.0:1782756276.578468:0:11978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782756276.578473:0:11978:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63d200, rc 0) 00000100:00100000:2.0:1782756276.578584:0:11978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7ff37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+28:11606:x1869355210079360:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 1750us (2192us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1782756276.578594:0:11978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 234 00000100:00100000:1.0:1782756276.582504:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756276.582731:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210079488 00000100:00100000:2.0:1782756276.582745:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210079488 00000100:00100000:2.0:1782756276.582830:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17 00000100:00100000:2.0:1782756276.582862:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+28:2355:x1869355210079488:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782756276.582895:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756276.582926:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d200/0x5e4fb0a8aa199b81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce230 expref: 28 pid: 11978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756276.582951:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:2.0:1782756276.582957:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782756276.583751:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756276.584494:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210079744 00000100:00100000:3.0:1782756276.584506:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210079744 00000100:00100000:2.0:1782756276.585361:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26487635-60cb-4aee-af8e-396654f6c3d8+28:2355:x1869355210079488:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2495us (2967us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756276.585375:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17 00000100:00100000:3.0:1782756276.585778:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 235 00000100:00100000:3.0:1782756276.585793:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+28:11606:x1869355210079744:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1782756276.585912:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199b8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756276.585935:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199b8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756276.585950:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199b8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756276.591885:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199b8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756276.591908:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199b8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756276.591916:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199b8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756276.591923:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168ca00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756276.591928:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199b8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756276.591937:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199b8f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756276.591960:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:2.0:1782756276.591963:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782756276.591977:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199b8f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756276.592001:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168ca00/0x5e4fb0a8aa199b8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756276.593381:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26487635-60cb-4aee-af8e-396654f6c3d8+28:11606:x1869355210079744:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 Request processed in 7580us (9622us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1782756276.593404:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 235 00000040:00080000:0.0:1782756276.596530:0:11537:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782756276.596644:0:11537:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782756276.598689:0:11537:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1782756276.598713:0:11537:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782756276.605689:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756276.605815:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210080000 00000100:00100000:0.0:1782756276.605828:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210080000 00000100:00100000:0.0:1782756276.605950:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 64 00000100:00100000:0.0:1782756276.605963:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+28:11606:x1869355210080000:12345-192.168.204.25@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1782756276.606365:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+29:11606:x1869355210080000:12345-192.168.204.25@tcp:35:lhsmtool_posix.0 Request processed in 404us (690us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1782756276.606486:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 64 00010000:00010000:2.0:1782756276.684399:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756277.196395:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c770fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222638208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782756277.196527:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756277.196681:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222638208 00000100:00100000:2.0:1782756277.196692:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222638208 00000100:00100000:2.0:1782756277.196777:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782756277.196791:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1869355222638208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782756277.196841:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1782756277.197113:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782756277.199668:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1869355222638208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2867us (3126us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756277.199687:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782756277.202040:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c770fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222638208:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782756277.708281:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782756277.916795:0:12517:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782756277.916804:0:12517:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782756277.916853:0:12517:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1782756277.916859:0:12517:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782756278.068423:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756278.068604:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210080256 00000100:00100000:0.0:1782756278.068618:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210080256 00000100:00080000:2.0:1782756278.068685:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782756278.068713:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 236 00000100:00100000:0.0:1782756278.069253:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+29:11627:x1869355210080256:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1782756278.069340:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756278.069371:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17400/0x5e4fb0a8aa199b96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce237 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756278.069553:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16000/0x5e4fb0a8aa199b9d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756278.069572:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16000/0x5e4fb0a8aa199b9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756278.069589:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16000/0x5e4fb0a8aa199b9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782756278.069603:0:6579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1782756278.069767:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17400/0x5e4fb0a8aa199b96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce237 expref: 32 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756278.069790:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16000/0x5e4fb0a8aa199b9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce237 expref: 31 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756278.069824:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:0.0:1782756278.069828:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1782756278.069833:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c76e16000, rc 0) 00000100:00100000:0.0:1782756278.070194:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+31:11627:x1869355210080256:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1467us (1785us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1782756278.070204:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 236 00000100:00100000:2.0:1782756278.076629:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756278.076959:0:11978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210080384 00000100:00100000:1.0:1782756278.076973:0:11978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210080384 00000100:00100000:1.0:1782756278.077266:0:11978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 237 00000100:00100000:1.0:1782756278.077281:0:11978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+31:11627:x1869355210080384:12345-192.168.204.25@tcp:54:lfs.0 00010000:00010000:1.0:1782756278.077378:0:11978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4a00/0x5e4fb0a8aa199bab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756278.077401:0:11978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4a00/0x5e4fb0a8aa199bab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756278.077416:0:11978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4a00/0x5e4fb0a8aa199bab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756278.077571:0:11978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4a00/0x5e4fb0a8aa199bab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756278.077580:0:11978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4a00/0x5e4fb0a8aa199bab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756278.077587:0:11978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4a00/0x5e4fb0a8aa199bab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756278.077594:0:11978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4a00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756278.077599:0:11978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4a00/0x5e4fb0a8aa199bab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756278.077607:0:11978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4a00/0x5e4fb0a8aa199bab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756278.077622:0:11978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:1.0:1782756278.077625:0:11978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782756278.077631:0:11978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4a00/0x5e4fb0a8aa199bab lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756278.077638:0:11978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef4a00/0x5e4fb0a8aa199bab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11978 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756278.077787:0:11978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26487635-60cb-4aee-af8e-396654f6c3d8+31:11627:x1869355210080384:12345-192.168.204.25@tcp:54:lfs.0 Request processed in 509us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756278.077797:0:11978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 237 00000100:00100000:1.0:1782756278.154203:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756278.156210:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210080512 00000100:00100000:0.0:1782756278.156231:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210080512 00000100:00080000:2.0:1782756278.156391:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782756278.156456:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 72 00000100:00100000:0.0:1782756278.156469:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+7:2357:x1869355210080512:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1782756278.156495:0:6602:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756278.156524:0:6602:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fce191a/0x5e4fb0a8aa199bb2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce23e expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782756278.156558:0:6602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a42b3b2, atime: 0x6a42b3b1, ctime: 0x6a42b3b2, blocks: 0xb 00010000:00010000:0.0:1782756278.156588:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=319s v=(0 0) 00010000:00010000:0.0:1782756278.156593:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782756278.156604:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fce191a/0x5e4fb0a8aa199bb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce23e expref: 8 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756278.156626:0:6602:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002fce191a/0x5e4fb0a8aa199bb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce23e expref: 8 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756278.156641:0:6602:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c76e17400, rc 0) 00000100:00100000:0.0:1782756278.156811:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+8:2357:x1869355210080512:12345-192.168.204.25@tcp:101:cat.0 Request processed in 344us (2624us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756278.156819:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 72 00000100:00100000:3.0:1782756278.169285:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756278.169435:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210080640 00000100:00100000:0.0:1782756278.169448:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210080640 00002000:00100000:0.0:1782756278.169522:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9d3c78e12300 x1869355210080640/t0(0) o3->26487635-60cb-4aee-af8e-396654f6c3d8@192.168.204.25@tcp:459/0 lens 488/0 e 0 to 0 dl 1782756289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782756278.169534:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3c78e12300 with x1869355210080640 ext(0->4095) 00002000:00010000:0.0:1782756278.169542:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d3c78e12300 00000100:00100000:0.0:1782756278.169576:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8 00000100:00100000:0.0:1782756278.169587:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26487635-60cb-4aee-af8e-396654f6c3d8+8:2358:x1869355210080640:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1782756278.169935:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26487635-60cb-4aee-af8e-396654f6c3d8+8:2358:x1869355210080640:12345-192.168.204.25@tcp:3:cat.0 Request processed in 348us (670us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1782756278.169944:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8 00002000:00100000:0.0:1782756278.169953:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9d3c78e12300 x1869355210080640/t0(0) o3->26487635-60cb-4aee-af8e-396654f6c3d8@192.168.204.25@tcp:459/0 lens 488/4536 e 0 to 0 dl 1782756289 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782756278.169963:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d3c78e12300 with x1869355210080640 ext(0->4095) 00002000:00010000:0.0:1782756278.169967:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d3c78e12300 00000100:00100000:2.0:1782756278.568805:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756278.568846:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756278.568887:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756278.568915:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756278.568952:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756278.568995:0:10416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210081024 00000100:00100000:2.0:1782756278.569005:0:10416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210081024 00000100:00100000:2.0:1782756278.569050:0:10416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210081152 00000100:00100000:2.0:1782756278.569058:0:10416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210081152 00000100:00100000:2.0:1782756278.569134:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 72 00000100:00100000:2.0:1782756278.569144:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+8:2356:x1869355210081024:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:2.0:1782756278.569222:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+8:2356:x1869355210081024:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 79us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756278.569229:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 72 00000100:00100000:2.0:1782756278.569245:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 73 00000100:00100000:2.0:1782756278.569251:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77000a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+5:2356:x1869355210081152:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:2.0:1782756278.569273:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77000a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+5:2356:x1869355210081152:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 23us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756278.569278:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 73 00000100:00080000:2.0:1782756278.569295:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782756278.569465:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210081280 00000100:00100000:1.0:1782756278.569470:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210081280 00000100:00100000:1.0:1782756278.569521:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210080896 00000100:00100000:1.0:1782756278.569524:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210080896 00000100:00100000:1.0:1782756278.569544:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 126 00000100:00100000:1.0:1782756278.569551:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76e0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2356:x1869355210081280:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1782756278.569587:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76e0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2356:x1869355210081280:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 37us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756278.569593:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 126 00000100:00100000:1.0:1782756278.569605:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 127 00000100:00100000:1.0:1782756278.569611:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76e0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+31:2356:x1869355210080896:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1782756278.569634:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76e0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26487635-60cb-4aee-af8e-396654f6c3d8+31:2356:x1869355210080896:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 23us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756278.569640:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 127 00000100:00100000:3.0:1782756278.570017:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210080768 00000100:00100000:3.0:1782756278.570022:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210080768 00000100:00080000:2.0:1782756278.570129:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782756278.570260:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 284 00000100:00100000:3.0:1782756278.570270:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2356:x1869355210080768:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756278.570316:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2356:x1869355210080768:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 48us (1523us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756278.570323:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 284 00000100:00100000:0.0:1782756278.733441:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0daec403-69b6-4c98-a0ea-f519ca0a480f:3314:1869355222638336:0@lo:400:kworker.0 00000100:00100000:0.0:1782756278.733544:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756278.733601:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c50165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869355222638848:0@lo:400:kworker.0 00000100:00100000:0.0:1782756278.733634:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756278.733664:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782756278.733670:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869355222638464:0@lo:400:kworker.0 00000100:00100000:0.0:1782756278.733713:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756278.733734:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c50164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222638976:0@lo:400:kworker.0 00000100:00100000:0.0:1782756278.733765:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756278.733797:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869355222638592:0@lo:400:kworker.0 00000100:00100000:0.0:1782756278.733825:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756278.733862:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782756278.733868:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c809f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222638720:0@lo:400:kworker.0 00000100:00100000:0.0:1782756278.733892:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756278.733928:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222638336 00000100:00100000:0.0:1782756278.733937:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222638336 00000100:00100000:0.0:1782756278.734002:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1782756278.734012:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3314:x1869355222638336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756278.734100:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3314:x1869355222638336:12345-0@lo:400:kworker.0 Request processed in 63us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756278.734110:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1782756278.734167:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222638848 00000100:00100000:0.0:1782756278.734171:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222638848 00000100:00100000:0.0:1782756278.734205:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222638464 00000100:00100000:0.0:1782756278.734208:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222638464 00000100:00100000:0.0:1782756278.734225:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222638592 00000100:00100000:0.0:1782756278.734228:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222638592 00000100:00100000:0.0:1782756278.734243:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1782756278.734249:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869355222638848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756278.734285:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869355222638848:12345-0@lo:400:kworker.0 Request processed in 35us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756278.734291:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1782756278.734303:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1782756278.734319:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869355222638464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756278.734350:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869355222638464:12345-0@lo:400:kworker.0 Request processed in 32us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756278.734356:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1782756278.734368:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1782756278.734374:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869355222638592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756278.734404:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869355222638592:12345-0@lo:400:kworker.0 Request processed in 30us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756278.734410:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1782756278.734454:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869355222638592:0@lo:400:kworker.0 00000100:00100000:0.0:1782756278.734494:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869355222638464:0@lo:400:kworker.0 00000100:00100000:0.0:1782756278.734502:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0daec403-69b6-4c98-a0ea-f519ca0a480f:3314:1869355222638336:0@lo:400:kworker.0 00000100:00100000:0.0:1782756278.734511:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c50165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869355222638848:0@lo:400:kworker.0 00010000:00010000:2.0:1782756278.735254:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782756278.735270:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782756278.735289:0:10416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222638976 00000100:00100000:2.0:1782756278.735296:0:10416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222638976 00000100:00100000:2.0:1782756278.735364:0:10416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222638720 00000100:00100000:2.0:1782756278.735368:0:10416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222638720 00000100:00100000:2.0:1782756278.735393:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782756278.735402:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76993050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222638976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756278.735471:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76993050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222638976:12345-0@lo:400:kworker.0 Request processed in 71us (1704us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756278.735479:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782756278.735638:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782756278.735646:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3316:x1869355222638720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756278.735681:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3316:x1869355222638720:12345-0@lo:400:kworker.0 Request processed in 36us (1787us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756278.735700:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1782756278.735725:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782756278.735750:0:3314:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1782756278.735757:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d3c76d79c00, transno 4294967307 00000004:00080000:2.0:1782756278.735778:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1782756278.735796:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d3c78e59880, transno 4294967310 00000100:00100000:2.0:1782756278.735804:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c50164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222638976:0@lo:400:kworker.0 00000100:00100000:0.0:1782756278.737016:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c809f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222638720:0@lo:400:kworker.0 00000100:00100000:2.0:1782756278.739098:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782756278.739187:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222639104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782756278.739289:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756278.739511:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222639104 00000100:00100000:0.0:1782756278.739521:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222639104 00000100:00100000:0.0:1782756278.739592:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782756278.739604:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222639104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782756278.739658:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782756278.739716:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222639104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756278.739724:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782756278.739968:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222639104:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782756279.756388:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756280.781208:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782756280.811841:0:6627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:0.0:1782756280.811869:0:6627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:0.0:1782756280.815504:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1782756280.815524:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d3c50115540 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1782756280.815530:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d3c7fb90c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d3c50115d80 00000020:00080000:0.0:1782756280.815533:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d3c7fb90800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d3c76fa7000 00000020:00080000:2.0:1782756280.815574:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000020:00080000:2.0:1782756280.815759:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1782756280.816034:0:5825:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:3.0:1782756281.804171:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782756281.941116:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756281.941629:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210081408 00000100:00100000:0.0:1782756281.941640:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210081408 00000100:00100000:0.0:1782756281.941735:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 238 00000100:00100000:0.0:1782756281.941748:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77000a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+18:11272:x1869355210081408:12345-192.168.204.25@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1782756281.941870:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77000a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+18:11272:x1869355210081408:12345-192.168.204.25@tcp:60:lhsmtool_posix.0 Request processed in 124us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756281.941879:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 238 00000100:00080000:2.0:1782756281.942673:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782756281.952800:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756281.954654:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210081664 00000100:00100000:1.0:1782756281.954671:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210081664 00000100:00100000:1.0:1782756281.954753:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 65 00000100:00100000:1.0:1782756281.954763:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+18:11272:x1869355210081664:12345-192.168.204.25@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1782756281.955716:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+19:11272:x1869355210081664:12345-192.168.204.25@tcp:35:lhsmtool_posix.0 Request processed in 949us (2921us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1782756281.955726:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 65 00000100:00100000:3.0:1782756282.138921:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756282.139137:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210081792 00000100:00100000:0.0:1782756282.139150:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210081792 00000100:00080000:2.0:1782756282.139273:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782756282.139703:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 239 00000100:00100000:0.0:1782756282.139719:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:12077:x1869355210081792:12345-192.168.204.25@tcp:101:lsof.0 00010000:00010000:0.0:1782756282.140464:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756282.140496:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17c00/0x5e4fb0a8aa199bb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce245 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756282.140588:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199bc0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756282.140605:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756282.140619:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782756282.142170:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782756282.142181:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1782756282.143059:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756282.143148:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17c00/0x5e4fb0a8aa199bb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce245 expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756282.143176:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199bc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce245 expref: 6 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756282.143187:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c4ef38800) 00010000:00010000:0.0:1782756282.143190:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782756282.143206:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c76e17600, rc 0) 00000100:00100000:0.0:1782756282.144502:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+6:12077:x1869355210081792:12345-192.168.204.25@tcp:101:lsof.0 Request processed in 4775us (5593us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756282.144520:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 239 00000100:00100000:2.0:1782756282.318110:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222639232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782756282.318206:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756282.318745:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222639232 00000100:00100000:3.0:1782756282.318754:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222639232 00000100:00100000:3.0:1782756282.318869:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782756282.318880:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222639232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782756282.318928:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782756282.318991:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222639232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756282.318998:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1782756282.319143:0:3317:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1782756282.319150:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d3c76d7b100, transno 4294967322 00000004:00080000:1.0:1782756282.319168:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1782756282.319197:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222639232:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782756282.319787:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782756282.830147:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782756283.695477:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756283.695712:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756283.695770:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756283.695808:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756283.695856:0:10416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210082176 00000100:00100000:0.0:1782756283.695873:0:10416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210082176 00000100:00100000:2.0:1782756283.695914:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:2.0:1782756283.695972:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782756283.695973:0:10416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210082304 00000100:00100000:0.0:1782756283.695977:0:10416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210082304 00000100:00100000:2.0:1782756283.695999:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 76 00000100:00100000:1.0:1782756283.696055:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210082432 00000100:00100000:1.0:1782756283.696061:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210082432 00000100:00100000:1.0:1782756283.696142:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210082048 00000100:00100000:1.0:1782756283.696146:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210082048 00000100:00100000:1.0:1782756283.696186:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 131 00000100:00100000:1.0:1782756283.696195:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+6:2357:x1869355210082432:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756283.696268:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 77 00000100:00100000:0.0:1782756283.696280:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+5:2358:x1869355210082304:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1782756283.696310:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+6:2357:x1869355210082432:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 115us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756283.696322:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 131 00000100:00100000:0.0:1782756283.696324:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+5:2358:x1869355210082304:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 44us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756283.696334:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 77 00000100:00100000:1.0:1782756283.696348:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 132 00000100:00100000:1.0:1782756283.696358:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+19:2358:x1869355210082048:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1782756283.696398:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26487635-60cb-4aee-af8e-396654f6c3d8+19:2358:x1869355210082048:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 42us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756283.696406:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 132 00000100:00100000:2.0:1782756283.696518:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+7:2357:x1869355210082176:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:2.0:1782756283.696573:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26487635-60cb-4aee-af8e-396654f6c3d8+7:2357:x1869355210082176:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 554us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756283.696580:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 76 00000100:00080000:2.0:1782756283.696597:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782756283.696601:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782756283.697020:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210081920 00000100:00100000:3.0:1782756283.697028:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210081920 00000100:00100000:3.0:1782756283.697093:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 286 00000100:00100000:3.0:1782756283.697102:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2357:x1869355210081920:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756283.697136:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+13:2357:x1869355210081920:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 36us (1676us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756283.697143:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 286 00010000:00010000:3.0:1782756283.852380:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756283.852465:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782756283.852517:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0daec403-69b6-4c98-a0ea-f519ca0a480f:3315:1869355222639488:0@lo:400:kworker.0 00000100:00100000:1.0:1782756283.852633:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869355222639744:0@lo:400:kworker.0 00000100:00100000:0.0:1782756283.852634:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756283.852685:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756283.852705:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222639360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782756283.852718:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782756283.852728:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869355222639616:0@lo:400:kworker.0 00000100:00100000:0.0:1782756283.852742:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756283.852763:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756283.852776:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869355222640000:0@lo:400:kworker.0 00000100:00100000:1.0:1782756283.852791:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222640128:0@lo:400:kworker.0 00000100:00100000:0.0:1782756283.852807:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756283.852831:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756283.852832:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782756283.852886:0:10416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222640128 00000100:00100000:1.0:1782756283.852896:0:10416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222640128 00000100:00100000:2.0:1782756283.852924:0:8071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222639360 00000100:00100000:2.0:1782756283.852930:0:8071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222639360 00000100:00100000:1.0:1782756283.852976:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1782756283.852977:0:8071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782756283.852994:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3317:x1869355222640128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756283.852995:0:8071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1869355222639360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782756283.853049:0:8071:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782756283.853061:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3317:x1869355222640128:12345-0@lo:400:kworker.0 Request processed in 73us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756283.853112:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1782756283.853119:0:8071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1869355222639360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756283.853128:0:8071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1782756283.853140:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782756283.853156:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222639488 00000100:00100000:2.0:1782756283.853162:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222639488 00000100:00100000:1.0:1782756283.853187:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222640128:0@lo:400:kworker.0 00000100:00100000:1.0:1782756283.853222:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222639744 00000100:00100000:2.0:1782756283.853266:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1782756283.853275:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3315:x1869355222639488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756283.853310:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3315:x1869355222639488:12345-0@lo:400:kworker.0 Request processed in 37us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756283.853317:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1782756283.853353:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222639616 00000100:00100000:2.0:1782756283.853357:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222639616 00000100:00100000:2.0:1782756283.853383:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222640000 00000100:00100000:2.0:1782756283.853387:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222640000 00000100:00100000:2.0:1782756283.853427:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1782756283.853433:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869355222639616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756283.853473:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869355222639616:12345-0@lo:400:kworker.0 Request processed in 40us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756283.853479:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1782756283.853491:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1782756283.853497:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869355222640000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756283.853525:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869355222640000:12345-0@lo:400:kworker.0 Request processed in 29us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756283.853532:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1782756283.853547:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782756283.853656:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222639872:0@lo:400:kworker.0 00000100:00100000:0.0:1782756283.853766:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756283.853793:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869355222640000:0@lo:400:kworker.0 00000100:00100000:0.0:1782756283.853803:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0daec403-69b6-4c98-a0ea-f519ca0a480f:3315:1869355222639488:0@lo:400:kworker.0 00000100:00100000:0.0:1782756283.853819:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222639360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782756283.853862:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869355222639616:0@lo:400:kworker.0 00000100:00100000:2.0:1782756283.853932:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222639872 00000100:00100000:2.0:1782756283.853936:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222639872 00000100:00100000:1.0:1782756283.853945:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222639744 00000100:00100000:2.0:1782756283.853984:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1782756283.853993:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222639872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756283.854007:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1782756283.854017:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869355222639744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756283.854038:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222639872:12345-0@lo:400:kworker.0 Request processed in 46us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756283.854045:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1782756283.854071:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869355222639744:12345-0@lo:400:kworker.0 Request processed in 55us (1385us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756283.854104:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:0.0:1782756283.854395:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782756283.854419:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869355222639744:0@lo:400:kworker.0 00000100:00100000:0.0:1782756283.854446:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222639872:0@lo:400:kworker.0 00000001:02000400:0.0:1782756284.527659:0:12719:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 14:04:42 (1782756282) 00000040:00080000:2.0:1782756284.813232:0:11537:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782756284.813241:0:11537:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782756284.813519:0:11537:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1782756284.813526:0:11537:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1782756284.876486:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756285.901186:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782756285.930766:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1782756285.930789:0:5825:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1782756285.930869:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1782756285.930888:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1782756286.924267:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782756287.307047:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756287.307193:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210082688 00000100:00100000:0.0:1782756287.307204:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210082688 00000100:00100000:0.0:1782756287.307289:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 66 00000100:00100000:0.0:1782756287.307300:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+18:12298:x1869355210082688:12345-192.168.204.25@tcp:35:umount.0 00000100:00100000:0.0:1782756287.307915:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+19:12298:x1869355210082688:12345-192.168.204.25@tcp:35:umount.0 Request processed in 615us (876us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1782756287.307930:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 66 00000100:00080000:2.0:1782756287.308162:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782756287.310620:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756287.310784:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210082944 00000100:00100000:1.0:1782756287.310795:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210082944 00000100:00100000:1.0:1782756287.310871:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 67 00000100:00100000:1.0:1782756287.310881:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+19:12298:x1869355210082944:12345-192.168.204.25@tcp:35:umount.0 00000100:00100000:1.0:1782756287.314870:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+20:12298:x1869355210082944:12345-192.168.204.25@tcp:35:umount.0 Request processed in 3980us (4324us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1782756287.314886:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 67 00000100:00100000:3.0:1782756287.322069:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756287.323266:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210083200 00000100:00100000:0.0:1782756287.323280:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210083200 00000100:00100000:0.0:1782756287.323356:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 68 00000100:00100000:0.0:1782756287.323367:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4977ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+20:12298:x1869355210083200:12345-192.168.204.25@tcp:35:umount.0 00000100:00100000:0.0:1782756287.323843:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4977ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26487635-60cb-4aee-af8e-396654f6c3d8+21:12298:x1869355210083200:12345-192.168.204.25@tcp:35:umount.0 Request processed in 477us (1782us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1782756287.323852:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 68 00000100:00100000:2.0:1782756287.331397:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756287.334091:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210083456 00000100:00100000:1.0:1782756287.334418:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210083456 00000100:00100000:1.0:1782756287.334572:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 69 00000100:00100000:1.0:1782756287.334587:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+21:12298:x1869355210083456:12345-192.168.204.25@tcp:35:umount.0 00000100:00100000:1.0:1782756287.335172:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26487635-60cb-4aee-af8e-396654f6c3d8+22:12298:x1869355210083456:12345-192.168.204.25@tcp:35:umount.0 Request processed in 586us (3789us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1782756287.335182:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 69 00000100:00100000:0.0:1782756287.344506:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756287.344555:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756287.344660:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756287.344798:0:10416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210083968 00000100:00100000:1.0:1782756287.344840:0:10416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210083968 00000100:00100000:1.0:1782756287.344991:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 73 00000100:00100000:1.0:1782756287.345006:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+5:2354:x1869355210083968:12345-192.168.204.25@tcp:9:umount.0 00000020:00000080:1.0:1782756287.345057:0:10416:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa198f10 00000100:00080000:1.0:1782756287.345070:0:10416:0:(import.c:65:import_set_state_nolock()) ffff9d3c76c0e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782756287.345151:0:10416:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1782756287.346007:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26487635-60cb-4aee-af8e-396654f6c3d8+2:2354:x1869355210083968:12345-192.168.204.25@tcp:9:umount.0 Request processed in 1000us (1510us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756287.346601:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 73 00000100:00080000:3.0:1782756287.350655:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782756287.351642:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782756287.352728:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210083584 00000100:00100000:2.0:1782756287.352745:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210083584 00000100:00100000:3.0:1782756287.352799:0:8367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210083840 00000100:00100000:3.0:1782756287.352823:0:8367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210083840 00000100:00100000:2.0:1782756287.352874:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18 00000100:00100000:2.0:1782756287.352890:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+14:2355:x1869355210083584:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782756287.352915:0:8367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19 00000100:00100000:3.0:1782756287.352948:0:8367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c79df9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+14:2358:x1869355210083840:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782756287.352965:0:8367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756287.353213:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756287.353235:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c41530e00/0x5e4fb0a8aa198bd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cddd0 expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756287.353256:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782756287.353281:0:8367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4b81bc00/0x5e4fb0a8aa198e1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde9b expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756287.353304:0:8367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756287.353359:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+12:2355:x1869355210083584:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 469us (8798us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756287.353363:0:8367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c79df9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+12:2358:x1869355210083840:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 415us (8699us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756287.353397:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18 00000100:00100000:3.0:1782756287.353764:0:8367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19 00000100:00100000:0.0:1782756287.356338:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756287.356425:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756287.356478:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210083712 00000100:00100000:1.0:1782756287.356489:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210083712 00000100:00100000:1.0:1782756287.356548:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20 00000100:00100000:1.0:1782756287.356559:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c809f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+11:2355:x1869355210083712:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782756287.356577:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756287.356679:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c41496000/0x5e4fb0a8aa198b9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdd98 expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756287.356701:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756287.356736:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210084352 00000100:00100000:2.0:1782756287.356741:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210084352 00000100:00100000:1.0:1782756287.356763:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c809f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:2355:x1869355210083712:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 205us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756287.356773:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20 00000100:00080000:3.0:1782756287.356798:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782756287.356818:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 74 00000100:00100000:2.0:1782756287.356833:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c50164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+7:2354:x1869355210084352:12345-192.168.204.25@tcp:9:umount.0 00000020:00000080:2.0:1782756287.356862:0:6602:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa199171 00000020:00010000:2.0:1782756287.356870:0:6602:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9d3b42afc800: total 0 00000100:00080000:2.0:1782756287.356875:0:6602:0:(import.c:65:import_set_state_nolock()) ffff9d3b42afc000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782756287.357672:0:6602:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:3.0:1782756287.357888:0:5791:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9d3b42afc800: total 0 00000100:00100000:2.0:1782756287.357952:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c50164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26487635-60cb-4aee-af8e-396654f6c3d8+5:2354:x1869355210084352:12345-192.168.204.25@tcp:9:umount.0 Request processed in 1121us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756287.357961:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 74 00010000:00010000:3.0:1782756287.359246:0:5791:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9d3b42afc800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1782756287.359316:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9209775/0x5e4fb0a8aa199514 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce070 expref: 4 pid: 10416 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756287.359862:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fce191a/0x5e4fb0a8aa199bb2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce23e expref: 3 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756287.359882:0:5791:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9d3b42afc800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1782756287.359898:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756287.359900:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756287.359902:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756287.366424:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756287.366494:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210085376 00000100:00100000:2.0:1782756287.366505:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210085376 00000100:00100000:2.0:1782756287.366681:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 240 00000100:00100000:2.0:1782756287.366697:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c50165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+22:2354:x1869355210085376:12345-192.168.204.25@tcp:39:umount.0 00000020:00000080:2.0:1782756287.366765:0:5803:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa198bac 00000020:00010000:2.0:1782756287.366783:0:5803:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9d3c77034800: total 0 00000100:00080000:2.0:1782756287.366787:0:5803:0:(import.c:65:import_set_state_nolock()) ffff9d3c7fa7a800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782756287.366836:0:5803:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:3.0:1782756287.366838:0:5792:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9d3c77034800: total 0 00010000:00010000:3.0:1782756287.366844:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756287.366891:0:5792:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9d3c77034800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1782756287.366949:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c4ef38800) 00010000:00010000:3.0:1782756287.366954:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782756287.366970:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c78ef5400/0x5e4fb0a8aa199576 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce08c expref: 21 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756287.367279:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c50165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26487635-60cb-4aee-af8e-396654f6c3d8+20:2354:x1869355210085376:12345-192.168.204.25@tcp:39:umount.0 Request processed in 587us (864us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1782756287.367287:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 240 00010000:00010000:1.0:1782756287.367332:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:1.0:1782756287.367336:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782756287.367342:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c800/0x5e4fb0a8aa1994d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce05b expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756287.367371:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:1.0:1782756287.367380:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782756287.367386:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16200/0x5e4fb0a8aa199b73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce229 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756287.367402:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:1.0:1782756287.367404:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782756287.367408:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4168d600/0x5e4fb0a8aa199871 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce165 expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756287.367421:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:1.0:1782756287.367424:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1782756287.367427:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16000/0x5e4fb0a8aa199b9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce237 expref: 16 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756287.367449:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:1.0:1782756287.367452:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782756287.367456:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63ca00/0x5e4fb0a8aa1991d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdf97 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756287.367467:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d3c58212100) 00010000:00010000:1.0:1782756287.367470:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782756287.367474:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa198e76 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdea9 expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756287.367499:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:1.0:1782756287.367501:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1782756287.367505:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81b800/0x5e4fb0a8aa1994ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce069 expref: 13 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756287.367529:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d3c4ef38f00) 00010000:00010000:1.0:1782756287.367532:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782756287.367536:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ae00/0x5e4fb0a8aa1993f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce023 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756287.367551:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:1.0:1782756287.367554:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782756287.367558:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c200/0x5e4fb0a8aa198ee6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdec5 expref: 11 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756287.367572:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d3c54288300) 00010000:00010000:1.0:1782756287.367574:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782756287.367578:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16400/0x5e4fb0a8aa199a93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce1f1 expref: 10 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756287.367590:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d3c58212a00) 00010000:00010000:1.0:1782756287.367592:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782756287.367596:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa199592 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce093 expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756287.367611:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3c54288100) 00010000:00010000:1.0:1782756287.367614:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756287.367617:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4b81ba00/0x5e4fb0a8aa198e92 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdeb0 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756287.367631:0:5792:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9d3c77034800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1782756287.367648:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756287.367655:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756287.367657:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756287.436438:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222640256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782756287.436518:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756287.437241:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222640256 00000100:00100000:1.0:1782756287.437250:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222640256 00000100:00100000:1.0:1782756287.437316:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782756287.437328:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222640256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782756287.437381:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1782756287.437459:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782756287.440955:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222640256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3621us (4427us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756287.440969:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782756287.442230:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222640256:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782756287.948300:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756288.303016:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756288.303065:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756288.303123:0:8367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210085504 00000100:00100000:0.0:1782756288.303145:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756288.303197:0:8367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210085504 00000100:00100000:2.0:1782756288.303233:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210085632 00000100:00100000:2.0:1782756288.303239:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210085632 00000100:00100000:3.0:1782756288.303319:0:8367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210085760 00000100:00100000:3.0:1782756288.303324:0:8367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210085760 00000100:00100000:2.0:1782756288.303721:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 21 00000100:00100000:0.0:1782756288.303737:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 22 00000100:00100000:2.0:1782756288.303744:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+12:2355:x1869355210085504:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1782756288.303755:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c501d7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+12:2356:x1869355210085632:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782756288.303762:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756288.303768:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756288.303807:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c41496c00/0x5e4fb0a8aa198c85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde0f expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756288.303827:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756288.303876:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c501d7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+11:2356:x1869355210085632:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 129us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756288.303883:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 22 00000100:00100000:0.0:1782756288.303900:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 23 00000100:00100000:0.0:1782756288.303906:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+10:2356:x1869355210085760:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782756288.303913:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756288.303922:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c41497200/0x5e4fb0a8aa198e14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cde94 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756288.303942:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756288.303959:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+9:2356:x1869355210085760:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 53us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756288.303964:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 23 00010000:00010000:2.0:1782756288.303996:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4b81a800/0x5e4fb0a8aa198c7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cdde5 expref: 8 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756288.304008:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756288.304033:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+7:2355:x1869355210085504:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 303us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756288.304040:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 21 00000100:00100000:0.0:1782756288.310498:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756288.310831:0:11978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210086016 00000100:00100000:2.0:1782756288.310851:0:11978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210086016 00000100:00080000:3.0:1782756288.310905:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782756288.311011:0:11978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 241 00000100:00100000:2.0:1782756288.311023:0:11978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+6:2354:x1869355210086016:12345-192.168.204.25@tcp:39:umount.0 00000020:00000080:2.0:1782756288.311066:0:11978:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa198c93 00000020:00010000:2.0:1782756288.311097:0:11978:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9d3c77037800: total 0 00000100:00080000:2.0:1782756288.311102:0:11978:0:(import.c:65:import_set_state_nolock()) ffff9d3c7fb15000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782756288.311134:0:11978:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:1.0:1782756288.311234:0:5792:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9d3c77037800: total 0 00010000:00010000:1.0:1782756288.311286:0:5792:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9d3c77037800, canceled 0 locks, left on hash table 1. 00000100:00100000:2.0:1782756288.311370:0:11978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7b9f710d-49d5-44e3-9f56-6807ec02dbcd+5:2354:x1869355210086016:12345-192.168.204.25@tcp:39:umount.0 Request processed in 349us (881us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1782756288.311378:0:11978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 241 00010000:00010000:1.0:1782756288.311392:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c4ef38800) 00010000:00010000:1.0:1782756288.311408:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782756288.311417:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17600/0x5e4fb0a8aa199bc0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce245 expref: 4 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756288.311442:0:5792:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9d3c77037800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1782756288.311459:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756288.311465:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756288.311467:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756288.331711:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756288.331747:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210086272 00000100:00100000:3.0:1782756288.331758:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210086272 00000100:00100000:3.0:1782756288.331827:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 288 00000100:00100000:3.0:1782756288.331838:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+7:2354:x1869355210086272:12345-192.168.204.25@tcp:251:umount.0 00000020:00000080:3.0:1782756288.331893:0:5798:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa198b89 00000020:00010000:3.0:1782756288.331902:0:5798:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9d3b41d99000: total 0 00000100:00080000:3.0:1782756288.331907:0:5798:0:(import.c:65:import_set_state_nolock()) ffff9d3b41d9a000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1782756288.332878:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbfeba57-ec56-49f1-8ea5-8df0e0e2db70+3:2354:x1869355210086272:12345-192.168.204.25@tcp:251:umount.0 Request processed in 1037us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756288.332887:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 288 00000020:00010000:0.0:1782756288.333250:0:5791:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9d3b41d99000: total 0 00010000:00010000:0.0:1782756288.333255:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756288.333322:0:5791:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9d3b41d99000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1782756288.333361:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4b81ac00/0x5e4fb0a8aa198bdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6cddd7 expref: 2 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756288.333378:0:5791:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9d3b41d99000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1782756288.333389:0:5791:0:(genops.c:906:class_export_put()) final put ffff9d3b41d99000/bbfeba57-ec56-49f1-8ea5-8df0e0e2db70 00010000:00010000:0.0:1782756288.333404:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756288.333419:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756288.333421:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782756288.334658:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3b41d99000/bbfeba57-ec56-49f1-8ea5-8df0e0e2db70 for MGS 00000020:00000080:3.0:1782756288.334697:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d3b41d9a000 for MGS 00000100:00100000:3.0:1782756288.973248:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782756288.973270:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222640384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782756288.973337:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756288.973604:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78edb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222640896:0@lo:400:kworker.0 00000100:00100000:0.0:1782756288.973634:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756288.973654:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782756288.973658:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0daec403-69b6-4c98-a0ea-f519ca0a480f:3314:1869355222640512:0@lo:400:kworker.0 00000100:00100000:0.0:1782756288.973683:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756288.973703:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b43616a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869355222641024:0@lo:400:kworker.0 00000100:00100000:0.0:1782756288.973728:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756288.973751:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869355222640640:0@lo:400:kworker.0 00000100:00100000:0.0:1782756288.973773:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756288.973803:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782756288.973809:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869355222640768:0@lo:400:kworker.0 00000100:00100000:0.0:1782756288.973830:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782756288.973841:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756288.973856:0:10416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222640896 00000100:00100000:0.0:1782756288.973862:0:10416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222640896 00000100:00100000:1.0:1782756288.973872:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222641024 00000100:00100000:1.0:1782756288.973875:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222641024 00000100:00100000:1.0:1782756288.973905:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222640640 00000100:00100000:0.0:1782756288.973905:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782756288.973907:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222640640 00000100:00100000:0.0:1782756288.973913:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43614e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222640896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756288.973922:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222640768 00000100:00100000:1.0:1782756288.973924:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222640768 00000100:00100000:1.0:1782756288.973936:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1782756288.973941:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869355222641024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756288.973961:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43614e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222640896:12345-0@lo:400:kworker.0 Request processed in 48us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756288.973967:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782756288.973979:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869355222641024:12345-0@lo:400:kworker.0 Request processed in 38us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756288.973986:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1782756288.973988:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222640512 00000100:00100000:0.0:1782756288.973991:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222640512 00000100:00100000:1.0:1782756288.973997:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1782756288.974002:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869355222640640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756288.974012:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1782756288.974017:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c4aafdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3314:x1869355222640512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756288.974031:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869355222640640:12345-0@lo:400:kworker.0 Request processed in 29us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756288.974037:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1782756288.974040:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c4aafdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3314:x1869355222640512:12345-0@lo:400:kworker.0 Request processed in 23us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756288.974047:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1782756288.974052:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1782756288.974053:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869355222640768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756288.974097:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869355222640768:12345-0@lo:400:kworker.0 Request processed in 44us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756288.974103:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1782756288.974124:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0daec403-69b6-4c98-a0ea-f519ca0a480f:3314:1869355222640512:0@lo:400:kworker.0 00000100:00100000:1.0:1782756288.974132:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869355222640768:0@lo:400:kworker.0 00000100:00100000:0.0:1782756288.974133:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b43616a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869355222641024:0@lo:400:kworker.0 00000100:00100000:1.0:1782756288.974141:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869355222640640:0@lo:400:kworker.0 00000100:00100000:0.0:1782756288.974141:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78edb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222640896:0@lo:400:kworker.0 00000100:00100000:3.0:1782756288.974202:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222640384 00000100:00100000:3.0:1782756288.974206:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222640384 00000100:00100000:3.0:1782756288.974246:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782756288.974253:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222640384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782756288.974287:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782756288.974318:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222640384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756288.974324:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1782756288.974341:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782756288.974345:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782756288.974365:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222640384:0@lo:13:osp-pre-1-0.0 00000020:01000004:2.0:1782756289.518944:0:12916:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1782756289.541217:0:12916:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1782756289.541265:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b600/0x5e4fb0a8aa198c1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198c23 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756289.541278:0:12916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b600/0x5e4fb0a8aa198c1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198c23 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756289.541285:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b600/0x5e4fb0a8aa198c1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5e4fb0a8aa198c23 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756289.541292:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b600/0x5e4fb0a8aa198c1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5e4fb0a8aa198c23 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756289.541311:0:12916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1782756289.541315:0:12916:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1782756289.541334:0:12916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782756289.541338:0:12916:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1782756289.541343:0:12916:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1782756289.541364:0:12916:0:(import.c:65:import_set_state_nolock()) ffff9d3c4abbc800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1782756289.541467:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782756289.541473:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b600/0x5e4fb0a8aa198c1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5e4fb0a8aa198c23 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756289.541480:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81b600 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:0.0:1782756289.541484:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b600/0x5e4fb0a8aa198c1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5e4fb0a8aa198c23 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756289.541493:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b600/0x5e4fb0a8aa198c1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x5e4fb0a8aa198c23 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782756289.541500:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b600/0x5e4fb0a8aa198c1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x5e4fb0a8aa198c23 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782756289.541505:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782756289.541508:0:5791:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1782756289.541510:0:5791:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1782756289.541534:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b600/0x5e4fb0a8aa198c1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5e4fb0a8aa198c23 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756289.541540:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782756289.541572:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b600/0x5e4fb0a8aa198c1c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5e4fb0a8aa198c23 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756289.541595:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b600/0x5e4fb0a8aa198c1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5e4fb0a8aa198c23 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756289.541606:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756289.541608:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756289.541610:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782756289.541812:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78edb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222641280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782756289.541898:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c770fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869355222641152:0@lo:39:umount.0 00000100:00100000:1.0:1782756289.541964:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756289.542172:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756289.542227:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222641280 00000100:00100000:3.0:1782756289.542234:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222641280 00000100:00100000:3.0:1782756289.542287:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782756289.542297:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+19:3316:x1869355222641280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782756289.542309:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782756289.542316:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222641152 00000100:00100000:0.0:1782756289.542322:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222641152 00010000:00010000:3.0:1782756289.542326:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4a63c400/0x5e4fb0a8aa198c23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5e4fb0a8aa198c1c expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756289.542342:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756289.542359:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1782756289.542369:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869355222641152:12345-0@lo:39:umount.0 00000100:00100000:3.0:1782756289.542384:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:3316:x1869355222641280:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756289.542392:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000020:00000080:0.0:1782756289.542394:0:6579:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa1989a6 00000100:00080000:0.0:1782756289.542404:0:6579:0:(import.c:65:import_set_state_nolock()) ffff9d3c78e71800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1782756289.542433:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78edb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0daec403-69b6-4c98-a0ea-f519ca0a480f:3316:1869355222641280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782756289.542466:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3313:x1869355222641152:12345-0@lo:39:umount.0 Request processed in 98us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756289.542473:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1782756289.542481:0:6579:0:(genops.c:906:class_export_put()) final put ffff9d3c78e74000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1782756289.542526:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c78e74000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1782756289.542583:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d3c78e71800 for lustre-MDT0000 00010000:00010000:1.0:1782756289.542929:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782756289.542952:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9d3c4abbc800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1782756289.542970:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c770fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869355222641152:0@lo:39:umount.0 00000100:00080000:2.0:1782756289.543031:0:12916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782756289.543034:0:12916:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1782756289.543039:0:12916:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1782756289.546165:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198c2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198c31 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756289.546199:0:12916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198c2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198c31 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756289.546207:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198c2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5e4fb0a8aa198c31 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756289.546215:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198c2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5e4fb0a8aa198c31 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756289.546244:0:12916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782756289.546251:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41531400/0x5e4fb0a8aa198b43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198b4a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756289.546258:0:12916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41531400/0x5e4fb0a8aa198b43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198b4a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756289.546264:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41531400/0x5e4fb0a8aa198b43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5e4fb0a8aa198b4a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756289.546271:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.125@tcp lock: ffff9d3c41531400/0x5e4fb0a8aa198b43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5e4fb0a8aa198b4a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756289.546282:0:12916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1782756289.546288:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63da00/0x5e4fb0a8aa198e3e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198e45 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756289.546294:0:12916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63da00/0x5e4fb0a8aa198e3e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198e45 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756289.546311:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63da00/0x5e4fb0a8aa198e3e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5e4fb0a8aa198e45 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756289.546319:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63da00/0x5e4fb0a8aa198e3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5e4fb0a8aa198e45 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756289.546328:0:12916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1782756289.546334:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41497400/0x5e4fb0a8aa1988f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa1988fe expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756289.546340:0:12916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41497400/0x5e4fb0a8aa1988f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa1988fe expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756289.546347:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41497400/0x5e4fb0a8aa1988f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5e4fb0a8aa1988fe expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756289.546353:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.125@tcp lock: ffff9d3c41497400/0x5e4fb0a8aa1988f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5e4fb0a8aa1988fe expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756289.546360:0:12916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1782756289.546364:0:12916:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1782756289.546384:0:12916:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1782756289.546389:0:12916:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1782756289.546393:0:12916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782756289.546398:0:12916:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:2.0:1782756289.546405:0:12916:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9d3c7fa78000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782756289.546410:0:12916:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9d3c7fc66000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782756289.546417:0:12916:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9d3c77037800 7b9f710d-49d5-44e3-9f56-6807ec02dbcd 192.168.204.25@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782756289.546429:0:12916:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9d3c77034800 26487635-60cb-4aee-af8e-396654f6c3d8 192.168.204.25@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:2.0:1782756289.546433:0:12916:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9d3c78fd4d40) has exports, disconnecting them 00000020:00080000:2.0:1782756289.546438:0:12916:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9d3c7fa78000), last request at 1782756288 00000020:00000080:2.0:1782756289.546445:0:12916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa198b0b 00000100:00080000:2.0:1782756289.546462:0:12916:0:(import.c:65:import_set_state_nolock()) ffff9d3c7fa78800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1782756289.546463:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1782756289.546471:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198c2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5e4fb0a8aa198c31 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756289.546480:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41530600 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:0.0:1782756289.546484:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198c2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5e4fb0a8aa198c31 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756289.546494:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198c2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x5e4fb0a8aa198c31 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782756289.546502:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198c2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x5e4fb0a8aa198c31 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1782756289.546513:0:12916:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d3c7fa78000): rc 0 10000000:01000000:0.0:1782756289.546518:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000020:00000080:2.0:1782756289.546519:0:12916:0:(genops.c:906:class_export_put()) final put ffff9d3c7fa78000/lustre-MDT0000-lwp-OST0001_UUID 10000000:01000000:0.0:1782756289.546525:0:5791:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1782756289.546528:0:5791:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:00080000:2.0:1782756289.546537:0:12916:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9d3c7fc66000), last request at 1782756288 00000020:00000080:2.0:1782756289.546541:0:12916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa198a32 00000100:00080000:2.0:1782756289.546548:0:12916:0:(import.c:65:import_set_state_nolock()) ffff9d3c7fc67000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1782756289.546555:0:12916:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d3c7fc66000): rc 0 00000020:00000080:2.0:1782756289.546557:0:12916:0:(genops.c:906:class_export_put()) final put ffff9d3c7fc66000/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:0.0:1782756289.546563:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198c2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5e4fb0a8aa198c31 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:2.0:1782756289.546565:0:12916:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa98c03fefae0 00010000:00010000:0.0:1782756289.546575:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:2.0:1782756289.546586:0:12916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1782756289.546590:0:12916:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1782756289.546604:0:12916:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:0.0:1782756289.546605:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198c2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5e4fb0a8aa198c31 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756289.546614:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c41530600/0x5e4fb0a8aa198c2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5e4fb0a8aa198c31 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756289.546629:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782756289.546632:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c41531400/0x5e4fb0a8aa198b43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5e4fb0a8aa198b4a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756289.546639:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41531400 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:0.0:1782756289.546642:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41531400/0x5e4fb0a8aa198b43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5e4fb0a8aa198b4a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756289.546650:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c41531400/0x5e4fb0a8aa198b43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5e4fb0a8aa198b4a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782756289.546658:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41531400/0x5e4fb0a8aa198b43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5e4fb0a8aa198b4a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782756289.546664:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1782756289.546667:0:5791:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1782756289.546669:0:5791:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000100:00080000:2.0:1782756289.546670:0:12916:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1782756289.546686:0:12916:0:(import.c:65:import_set_state_nolock()) ffff9d3b4114f800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1782756289.546695:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c41531400/0x5e4fb0a8aa198b43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5e4fb0a8aa198b4a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782756289.546700:0:12916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00010000:00010000:0.0:1782756289.546702:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782756289.546704:0:12916:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1782756289.546720:0:12916:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1782756289.546796:0:12916:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1782756289.546806:0:12916:0:(import.c:65:import_set_state_nolock()) ffff9d3c5014a800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1782756289.546835:0:12916:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9d3c78fd4d40) has no exports 00000020:00000080:3.0:1782756289.546989:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c7fa78000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:0.0:1782756289.547037:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c41531400/0x5e4fb0a8aa198b43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5e4fb0a8aa198b4a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756289.547045:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c41531400/0x5e4fb0a8aa198b43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5e4fb0a8aa198b4a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756289.547060:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782756289.547063:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63da00/0x5e4fb0a8aa198e3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5e4fb0a8aa198e45 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756289.547069:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63da00 already unused, calling callback (ffffffffc1c85c20) 00010000:00010000:1.0:1782756289.547143:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1782756289.547270:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c770fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869355222641536:0@lo:9:umount.0 00000100:00100000:1.0:1782756289.547338:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756289.547376:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869355222641792:0@lo:9:umount.0 00000100:00100000:1.0:1782756289.547399:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756289.547438:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222641536 00000100:00100000:1.0:1782756289.547445:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222641536 00000020:00000080:3.0:1782756289.548228:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c7fc66000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1782756289.548255:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d3c7fa78800 for lustre-MDT0000 00000020:00000080:3.0:1782756289.548260:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d3c7fc67000 for lustre-MDT0000 00000100:00080000:3.0:1782756289.548280:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782756289.549178:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782756289.549199:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b43616a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0daec403-69b6-4c98-a0ea-f519ca0a480f:3315:1869355222641664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782756289.549257:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756289.549318:0:8367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222641664 00000100:00100000:3.0:1782756289.549325:0:8367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222641664 00000100:00100000:3.0:1782756289.549372:0:8367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782756289.549380:0:8367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0daec403-69b6-4c98-a0ea-f519ca0a480f+18:3315:x1869355222641664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782756289.549393:0:8367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756289.549411:0:8367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c40031600/0x5e4fb0a8aa198b4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5e4fb0a8aa198b43 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756289.549430:0:8367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782756289.549463:0:8367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:3315:x1869355222641664:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756289.549470:0:8367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782756289.549495:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78edb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222641408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782756289.549519:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756289.549560:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b43616a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0daec403-69b6-4c98-a0ea-f519ca0a480f:3315:1869355222641664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782756289.549588:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222641408 00000100:00100000:3.0:1782756289.549592:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222641408 00000100:00100000:3.0:1782756289.549617:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782756289.549624:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+17:3317:x1869355222641408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782756289.549632:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756289.549642:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4a63ce00/0x5e4fb0a8aa198c31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5e4fb0a8aa198c2a expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756289.549667:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782756289.549871:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:3317:x1869355222641408:12345-0@lo:103:ldlm_bl.0 Request processed in 246us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756289.549878:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782756289.549905:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78edb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222641408:0@lo:103:ldlm_bl.0 10000000:00010000:0.0:1782756289.550447:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63da00/0x5e4fb0a8aa198e3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5e4fb0a8aa198e45 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756289.550465:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63da00/0x5e4fb0a8aa198e3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5e4fb0a8aa198e45 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782756289.550473:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63da00/0x5e4fb0a8aa198e3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5e4fb0a8aa198e45 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756289.550474:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222641792 00000100:00100000:1.0:1782756289.550483:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222641792 10000000:01000000:0.0:1782756289.550483:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1782756289.550488:0:5791:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1782756289.550491:0:5791:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1782756289.550518:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63da00/0x5e4fb0a8aa198e3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5e4fb0a8aa198e45 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756289.550522:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1782756289.550530:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1782756289.550535:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869355222641536:12345-0@lo:9:umount.0 00010000:00010000:0.0:1782756289.550551:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63da00/0x5e4fb0a8aa198e3e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5e4fb0a8aa198e45 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1782756289.550562:0:6603:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa198a7f 00000100:00080000:1.0:1782756289.550574:0:6603:0:(import.c:65:import_set_state_nolock()) ffff9d3c4a6f8000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1782756289.550585:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63da00/0x5e4fb0a8aa198e3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5e4fb0a8aa198e45 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756289.550600:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756289.550603:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1782756289.550605:0:6603:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:0.0:1782756289.550605:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756289.550623:0:10416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1782756289.550634:0:10416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1869355222641792:12345-0@lo:9:umount.0 00000020:00000080:0.0:1782756289.550651:0:10416:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa198b74 00000100:00080000:0.0:1782756289.550657:0:10416:0:(import.c:65:import_set_state_nolock()) ffff9d3c77032000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782756289.550685:0:10416:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1782756289.550833:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3313:x1869355222641536:12345-0@lo:9:umount.0 Request processed in 300us (3495us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756289.550841:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782756289.550866:0:10416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3313:x1869355222641792:12345-0@lo:9:umount.0 Request processed in 233us (3464us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756289.550875:0:10416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1782756289.550893:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9d3b4114f800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1782756289.550897:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:1.0:1782756289.550909:0:3313:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00100000:0.0:1782756289.550909:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b43616a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0daec403-69b6-4c98-a0ea-f519ca0a480f:3314:1869355222641920:0@lo:103:ldlm_bl.0 00000004:00080000:1.0:1782756289.550913:0:3313:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782756289.550919:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c770fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869355222641536:0@lo:9:umount.0 00000100:00080000:1.0:1782756289.550934:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9d3c5014a800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1782756289.550943:0:3313:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1782756289.550947:0:3313:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1782756289.550947:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756289.550954:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869355222641792:0@lo:9:umount.0 00000100:00100000:0.0:1782756289.551011:0:8367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222641920 00000100:00100000:0.0:1782756289.551016:0:8367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222641920 00010000:00010000:1.0:1782756289.551057:0:12917:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756289.551065:0:8367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1782756289.551066:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c41497400/0x5e4fb0a8aa1988f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5e4fb0a8aa1988fe expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756289.551102:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41497400 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:1.0:1782756289.551106:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41497400/0x5e4fb0a8aa1988f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5e4fb0a8aa1988fe expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756289.551110:0:8367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0daec403-69b6-4c98-a0ea-f519ca0a480f+16:3314:x1869355222641920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782756289.551125:0:8367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756289.551138:0:8367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4b81a600/0x5e4fb0a8aa198e45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5e4fb0a8aa198e3e expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756289.551148:0:8367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756289.551180:0:8367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:3314:x1869355222641920:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756289.551187:0:8367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782756289.551215:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b43616a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0daec403-69b6-4c98-a0ea-f519ca0a480f:3314:1869355222641920:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782756289.551235:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756289.551351:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c41497400/0x5e4fb0a8aa1988f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5e4fb0a8aa1988fe expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782756289.551359:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41497400/0x5e4fb0a8aa1988f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5e4fb0a8aa1988fe expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756289.551364:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1782756289.551367:0:5792:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1782756289.551369:0:5792:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1782756289.551386:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c41497400/0x5e4fb0a8aa1988f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5e4fb0a8aa1988fe expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756289.551392:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782756289.551425:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c41497400/0x5e4fb0a8aa1988f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5e4fb0a8aa1988fe expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756289.551432:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c41497400/0x5e4fb0a8aa1988f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5e4fb0a8aa1988fe expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756289.551446:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756289.551448:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756289.551450:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756289.551455:0:12917:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756289.551457:0:12917:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756289.551473:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782756289.551484:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222642048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782756289.551511:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756289.551666:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222642048 00000100:00100000:3.0:1782756289.551671:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222642048 00000100:00100000:3.0:1782756289.551705:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782756289.551712:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+15:3317:x1869355222642048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782756289.551720:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756289.551824:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c40031400/0x5e4fb0a8aa1988fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5e4fb0a8aa1988f7 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756289.551839:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782756289.551906:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0daec403-69b6-4c98-a0ea-f519ca0a480f+14:3317:x1869355222642048:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756289.551913:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782756289.551954:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222642048:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1782756289.556063:0:12916:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9d3c78fd4d40) has no exports 00000020:00000080:3.0:1782756289.603352:0:12916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa198952 00000020:00000080:3.0:1782756289.603368:0:12916:0:(genops.c:906:class_export_put()) final put ffff9d3c809ed800/lustre-QMT0000_UUID 00000020:01000000:3.0:1782756289.603500:0:12916:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1782756289.603734:0:12916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782756289.603746:0:12916:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1782756289.603751:0:12916:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9d3c4aba4d40) has no exports 00000020:00000080:3.0:1782756289.604477:0:12916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa19894b 00000020:00000080:3.0:1782756289.604487:0:12916:0:(genops.c:906:class_export_put()) final put ffff9d3c79c9d000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1782756289.604603:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c809ed800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1782756289.604607:0:12916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782756289.604618:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c79c9d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1782756289.604635:0:12916:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1782756289.604640:0:12916:0:(genops.c:906:class_export_put()) final put ffff9d3c79c99000/lustre-QMT0000_UUID 00000020:00000080:2.0:1782756289.604643:0:12916:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c79c99000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1782756289.604652:0:12916:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:0.0:1782756289.996321:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756291.020423:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782756291.065225:0:6627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1782756291.065235:0:6627:0:(genops.c:906:class_export_put()) final put ffff9d3c4a6fb800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1782756291.065269:0:6627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 26487635-60cb-4aee-af8e-396654f6c3d8 00000020:00000080:0.0:1782756291.065273:0:6627:0:(genops.c:906:class_export_put()) final put ffff9d3b42afc800/26487635-60cb-4aee-af8e-396654f6c3d8 00000001:00100000:0.0:1782756291.065420:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1782756291.065425:0:7503:0:(genops.c:906:class_export_put()) final put ffff9d3c77032800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782756291.065427:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c4a6fb800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000001:00100000:0.0:1782756291.065452:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 26487635-60cb-4aee-af8e-396654f6c3d8 00000020:00000080:0.0:1782756291.065455:0:7503:0:(genops.c:906:class_export_put()) final put ffff9d3c76c08800/26487635-60cb-4aee-af8e-396654f6c3d8 00000001:00080000:1.0:1782756291.065689:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00080000:1.0:1782756291.065712:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:1.0:1782756291.065745:0:5825:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7b9f710d-49d5-44e3-9f56-6807ec02dbcd 00000001:00080000:1.0:1782756291.065753:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1782756291.065755:0:5825:0:(genops.c:906:class_export_put()) final put ffff9d3c77037800/7b9f710d-49d5-44e3-9f56-6807ec02dbcd 00000020:00000080:2.0:1782756291.065925:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3b42afc800/26487635-60cb-4aee-af8e-396654f6c3d8 for lustre-OST0000 00000020:00000080:2.0:1782756291.065947:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c77032800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1782756291.065963:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d3c4a6f8000 for lustre-OST0000 00000020:00000080:2.0:1782756291.065970:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d3b42afc000 for lustre-OST0000 00000020:00000080:2.0:1782756291.065973:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d3c77032000 for lustre-OST0001 00000020:00000080:2.0:1782756291.066969:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c76c08800/26487635-60cb-4aee-af8e-396654f6c3d8 for lustre-OST0001 00000020:00000080:2.0:1782756291.067000:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d3c76c0e000 for lustre-OST0001 00000001:00100000:1.0:1782756291.069291:0:5825:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 26487635-60cb-4aee-af8e-396654f6c3d8 00000001:00080000:1.0:1782756291.069305:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1782756291.069310:0:5825:0:(genops.c:906:class_export_put()) final put ffff9d3c77034800/26487635-60cb-4aee-af8e-396654f6c3d8 00000020:00000080:3.0:1782756291.071860:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c77037800/7b9f710d-49d5-44e3-9f56-6807ec02dbcd for lustre-MDT0000 00000020:00000080:3.0:1782756291.073473:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c77034800/26487635-60cb-4aee-af8e-396654f6c3d8 for lustre-MDT0000 00000020:00000080:3.0:1782756291.073534:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d3c7fb15000 for lustre-MDT0000 00000020:00000080:3.0:1782756291.073538:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d3c7fa7a800 for lustre-MDT0000 00000020:01000000:2.0:1782756291.660216:0:12916:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d3c454274e0 - data ffff9d3c64f80e58/ffff9d3c80c3bc00 00000020:01000000:2.0:1782756291.660351:0:12916:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d3c482c8f60 - data ffff9d3c65bf5948/ffff9d3c6dd40000 00000001:00000004:2.0:1782756291.668293:0:12916:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1782756291.713067:0:12916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1782756291.713103:0:12916:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1782756291.713119:0:12916:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1782756291.713121:0:12916:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1782756291.713466:0:6794:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1782756291.713470:0:6794:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1782756291.713479:0:6794:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1782756291.714209:0:12916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1782756291.714213:0:12916:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1782756291.714229:0:12916:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1782756291.714232:0:12916:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1782756291.714648:0:7951:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1782756291.714652:0:7951:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1782756291.714660:0:7951:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1782756291.753514:0:12916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa19891a 00000020:00000080:2.0:1782756291.753525:0:12916:0:(genops.c:906:class_export_put()) final put ffff9d3c78fdf800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1782756291.753708:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c78fdf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1782756291.754793:0:12916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa19892f 00000020:00000080:2.0:1782756291.754801:0:12916:0:(genops.c:906:class_export_put()) final put ffff9d3c78fde800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1782756291.754914:0:12916:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1782756291.754921:0:12916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782756291.754929:0:12916:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1782756291.754945:0:12916:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9d3c78fd3380) has no exports 00000004:01000000:2.0:1782756291.755136:0:12916:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1782756291.755145:0:12916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa198b6d 00000020:00000080:2.0:1782756291.755150:0:12916:0:(genops.c:906:class_export_put()) final put ffff9d3c5014b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1782756291.755237:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c78fde800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1782756291.755298:0:12916:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1782756291.755303:0:12916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782756291.755375:0:12916:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1782756291.755379:0:12916:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9d3c44d1b380) has no exports 00000020:00000080:2.0:1782756291.755386:0:12916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa198b66 00000020:00000080:2.0:1782756291.755391:0:12916:0:(genops.c:906:class_export_put()) final put ffff9d3b4114b000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1782756291.755407:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c5014b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:2.0:1782756291.756027:0:12916:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1782756291.756033:0:12916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1782756291.756037:0:12916:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1782756291.756044:0:12916:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1782756291.756047:0:12916:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1782756291.756109:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3b4114b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1782756291.756245:0:12916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782756291.756253:0:12916:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782756291.756259:0:12916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa198a78 00000020:00000080:2.0:1782756291.756264:0:12916:0:(genops.c:906:class_export_put()) final put ffff9d3c4a6f9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1782756291.756287:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d3c5014a800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1782756291.756293:0:36:0:(genops.c:906:class_export_put()) final put ffff9d3c76c0d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1782756291.756295:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c76c0d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1782756291.756300:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1782756291.756485:0:12916:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1782756291.756490:0:12916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782756291.756494:0:12916:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1782756291.756497:0:12916:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9d3c50024d40) has no exports 00000020:00000080:2.0:1782756291.756502:0:12916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa198a71 00000020:00000080:2.0:1782756291.756506:0:12916:0:(genops.c:906:class_export_put()) final put ffff9d3b41149800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1782756291.756520:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c4a6f9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:2.0:1782756291.757302:0:12916:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1782756291.757307:0:12916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1782756291.757372:0:12916:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1782756291.757378:0:12916:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1782756291.757380:0:12916:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1782756291.757419:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3b41149800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1782756291.757511:0:12916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782756291.757550:0:12916:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782756291.757599:0:12916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782756291.757604:0:12916:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782756291.757607:0:12916:0:(genops.c:906:class_export_put()) final put ffff9d3c80976800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782756291.757610:0:12916:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c80976800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1782756291.757615:0:12916:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782756291.757772:0:12916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa198936 00000020:00000080:2.0:1782756291.757777:0:12916:0:(genops.c:906:class_export_put()) final put ffff9d3c78fde000/lustre-MDD0000_UUID 00000020:00000080:0.0:1782756291.757942:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d3b4114f800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1782756291.757947:0:36:0:(genops.c:906:class_export_put()) final put ffff9d3b41149000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1782756291.757949:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3b41149000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1782756291.757953:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1782756291.759121:0:12916:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1782756291.759129:0:12916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782756291.759137:0:12916:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1782756291.759142:0:12916:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9d3c78fd19c0) has no exports 00000020:00000080:2.0:1782756291.759263:0:12916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782756291.759270:0:12916:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1782756291.759277:0:12916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa19893d 00000020:00000080:2.0:1782756291.759284:0:12916:0:(genops.c:906:class_export_put()) final put ffff9d3c78fdf000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1782756291.759295:0:12916:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d3c4505a800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1782756291.759299:0:12916:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9d3c4505a800 3 00000020:01000004:2.0:1782756291.759302:0:12916:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d3c4505a800 from lustre-MDT0000 00000020:00000080:2.0:1782756291.759369:0:12916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782756291.759375:0:12916:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1782756291.759378:0:12916:0:(genops.c:906:class_export_put()) final put ffff9d3c78fda800/lustre-MDT0000_UUID 00000020:00000080:2.0:1782756291.759380:0:12916:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c78fda800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1782756291.759393:0:12916:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1782756291.759450:0:12916:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1782756291.759454:0:12916:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1782756291.759458:0:12916:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1782756291.759461:0:12916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782756291.759464:0:12916:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1782756291.759471:0:12916:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9d3c48fbe800 0daec403-69b6-4c98-a0ea-f519ca0a480f 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782756291.759971:0:12916:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9d3c50020000) has exports, disconnecting them 00000020:00080000:2.0:1782756291.759978:0:12916:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9d3c48fbe800), last request at 1782756113 00000020:00000080:2.0:1782756291.759995:0:12916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa1988db 00000020:00010000:2.0:1782756291.760009:0:12916:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9d3c48fbe800: total 2 00000100:00080000:2.0:1782756291.760014:0:12916:0:(import.c:65:import_set_state_nolock()) ffff9d3c70472800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1782756291.760039:0:12916:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d3c48fbe800): rc 0 00000020:00080000:2.0:1782756291.760043:0:12916:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9d3c50020000) has no exports 00000020:00010000:2.0:1782756291.760060:0:12917:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9d3c48fbe800: total 2 00010000:00010000:2.0:1782756291.760116:0:12917:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9d3c48fbe800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1782756291.760151:0:12917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c41497000/0x5e4fb0a8aa198bf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5e4fb0a8aa198bf2 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756291.760191:0:12917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c41531800/0x5e4fb0a8aa198c07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5e4fb0a8aa198c00 expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756291.760209:0:12917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c41530800/0x5e4fb0a8aa198c15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5e4fb0a8aa198c0e expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756291.760219:0:12917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4168c000/0x5e4fb0a8aa1989e5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5e4fb0a8aa1989de expref: 6 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756291.760235:0:12917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4168d000/0x5e4fb0a8aa198c3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5e4fb0a8aa198c38 expref: 5 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756291.760247:0:12917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4b81b400/0x5e4fb0a8aa198beb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5e4fb0a8aa198be4 expref: 4 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756291.760258:0:12917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4a63d400/0x5e4fb0a8aa198e29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5e4fb0a8aa198e22 expref: 3 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756291.760270:0:12917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c41496400/0x5e4fb0a8aa198e37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5e4fb0a8aa198e30 expref: 2 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756291.760285:0:12917:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9d3c48fbe800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1782756291.760303:0:12917:0:(genops.c:906:class_export_put()) final put ffff9d3c48fbe800/0daec403-69b6-4c98-a0ea-f519ca0a480f 00010000:00010000:2.0:1782756291.760310:0:12917:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756291.760311:0:12917:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756291.760313:0:12917:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782756291.760371:0:5797:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9d3c4a0a5800:5797] 1 exiting: rc = 0 00000100:00100000:2.0:1782756291.760470:0:5796:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9d3c4aab8e00:5796] 0 exiting: rc = 1 00000020:00000080:0.0:1782756291.760492:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c78fde000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1782756291.760499:0:36:0:(genops.c:906:class_export_put()) final put ffff9d3c78fdc800/lustre-MDD0000_UUID 00000020:00000080:0.0:1782756291.760502:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c78fdc800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1782756291.760511:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1782756291.760749:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c78fdf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1782756291.760755:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c48fbe800/0daec403-69b6-4c98-a0ea-f519ca0a480f for MGS 00000020:00000080:0.0:1782756291.760788:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d3c70472800 for MGS 00000100:00100000:3.0:1782756291.760917:0:5798:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9d3c4a0a5400:5798] 2 exiting: rc = 0 00000100:00100000:0.0:1782756291.760984:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.760995:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761004:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761012:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761022:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761030:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761038:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761047:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761056:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761064:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761105:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761115:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761124:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761142:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761153:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761161:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761171:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761184:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761198:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761204:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761280:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761289:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761294:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761300:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761306:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761376:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761382:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761388:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761394:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761399:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761405:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761411:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761416:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761421:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761427:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761432:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761438:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761443:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761448:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761453:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761459:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761465:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761471:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761476:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761481:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761487:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761492:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761497:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761512:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761518:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761523:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761530:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761535:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761541:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761546:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761553:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761559:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761564:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761570:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761576:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761649:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761657:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761663:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.761668:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1782756291.762507:0:12916:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1782756291.762512:0:12916:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1782756291.763212:0:12916:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d3c48e98300 - data ffff9d3c6f624360/ffff9d3c7fb5e000 00000020:01000000:0.0:1782756291.763422:0:12916:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d3c48cb2540 - data ffff9d3c65a021b0/ffff9d3c4aa18000 00000020:00000080:0.0:1782756291.764014:0:12916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa1988bf 00000020:00000080:0.0:1782756291.764023:0:12916:0:(genops.c:906:class_export_put()) final put ffff9d3c48f0d000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1782756291.764043:0:12916:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d3c4505a800 from MGS, refs=2 00000020:01000004:0.0:1782756291.764047:0:12916:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9d3c4505a800 2 00000020:01000004:0.0:1782756291.764051:0:12916:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d3c4505a800 from MGS 00000020:00000080:2.0:1782756291.764069:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c48f0d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1782756291.764100:0:12916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782756291.764108:0:12916:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1782756291.764111:0:12916:0:(genops.c:906:class_export_put()) final put ffff9d3c49fcf800/MGS 00000020:00000080:0.0:1782756291.764114:0:12916:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c49fcf800/MGS for MGS 00000020:01000000:0.0:1782756291.764122:0:12916:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1782756291.764172:0:12916:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1782756291.764176:0:12916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782756291.764181:0:12916:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1782756291.764189:0:12916:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9d3c4a736000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1782756291.764203:0:12916:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9d3c78fd0000) has exports, disconnecting them 00000020:00080000:0.0:1782756291.764208:0:12916:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9d3c4a736000), last request at 1782756114 00000020:00000080:0.0:1782756291.764212:0:12916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa19898a 00000020:00080000:0.0:1782756291.764224:0:12916:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d3c4a736000): rc 0 00000020:00000080:0.0:1782756291.764230:0:12916:0:(genops.c:906:class_export_put()) final put ffff9d3c4a736000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1782756291.764281:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c4a736000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1782756291.772057:0:12916:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1782756291.772066:0:12916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782756291.772070:0:12916:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1782756291.772200:0:12916:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1782756291.772472:0:12916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782756291.772481:0:12916:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1782756291.772523:0:12916:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9d3c4505a800 1 00000020:00000080:0.0:1782756291.772531:0:12916:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa1988b1 00000020:00000080:0.0:1782756291.772541:0:12916:0:(genops.c:906:class_export_put()) final put ffff9d3c49fc9800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1782756291.772572:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d3c4abbc800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1782756291.772643:0:8:0:(genops.c:906:class_export_put()) final put ffff9d3c80970800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1782756291.772648:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c80970800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1782756291.772654:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:0.0:1782756291.772781:0:12916:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1782756291.772786:0:12916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782756291.772790:0:12916:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1782756291.772794:0:12916:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9d3c44d1cd40) has no exports 00000020:00000080:2.0:1782756291.774005:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c49fc9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1782756291.785817:0:12916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782756291.785831:0:12916:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1782756291.785837:0:12916:0:(genops.c:906:class_export_put()) final put ffff9d3c4505c000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1782756291.785841:0:12916:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c4505c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1782756291.785850:0:12916:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1782756291.785993:0:12916:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9d3c45058800 00000020:01000000:0.0:1782756291.786019:0:12916:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1782756291.786023:0:12916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782756291.786027:0:12916:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1782756291.786032:0:12916:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9d3c44d199c0) has no exports 00000100:00100000:0.0:1782756291.786141:0:6579:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9d3c48381600:6579] 3 exiting: rc = 0 00000100:00100000:2.0:1782756291.786220:0:5804:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9d3c4b932800:5804] 1 exiting: rc = 0 00000100:00100000:0.0:1782756291.786259:0:5803:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9d3c4b932600:5803] 0 exiting: rc = 1 00000100:00100000:0.0:1782756291.787548:0:5805:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9d3c4b933e00:5805] 2 exiting: rc = 0 00000100:00100000:0.0:1782756291.790198:0:11978:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9d3c4b812600:11978] 4 exiting: rc = 0 00000100:00100000:2.0:1782756291.790292:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790300:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790305:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790310:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790316:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790321:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790327:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790332:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790337:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790342:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790348:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790353:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790358:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790364:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790370:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790376:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790383:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790404:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790413:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790422:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790432:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790441:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790450:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790460:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790470:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790479:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790487:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790496:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790506:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790515:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790525:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790534:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790544:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790552:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790562:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790650:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790659:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790669:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790678:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790687:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790697:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790707:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790717:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790737:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790748:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790776:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790786:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790805:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790812:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790819:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790825:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790830:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790843:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790849:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790855:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790860:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790865:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790873:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790882:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790892:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790902:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790913:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790922:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.790933:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.796131:0:5807:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9d3c497a4600:5807] 1 exiting: rc = 0 00000100:00100000:1.0:1782756291.796190:0:12427:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff9d3b426ae600:12427] 2 exiting: rc = 0 00000100:00100000:1.0:1782756291.796276:0:5806:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9d3c4a6b2200:5806] 0 exiting: rc = 1 00000100:00100000:2.0:1782756291.796337:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796348:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796356:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796363:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796372:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796381:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796392:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796401:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796409:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796419:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796428:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796434:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796440:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796446:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796451:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796463:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796468:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796473:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796478:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796484:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796489:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796494:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796499:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796517:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796522:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796527:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796532:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796538:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796543:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796548:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796553:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796558:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796564:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796581:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796587:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796591:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796596:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796601:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796606:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796611:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796616:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796622:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796629:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796635:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796640:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796646:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796653:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796660:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796667:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796672:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796677:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796682:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796687:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796692:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796697:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796703:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796708:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796712:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796736:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796741:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796747:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796753:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796759:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.796764:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.800346:0:5809:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9d3c500d6000:5809] 1 exiting: rc = 0 00000100:00100000:1.0:1782756291.800408:0:5808:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9d3c4a0a4c00:5808] 0 exiting: rc = 1 00000100:00100000:2.0:1782756291.800622:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.800631:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.800644:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.800651:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.800657:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.800664:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.800672:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.800679:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.800685:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.800692:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.800697:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.800716:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.800737:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.800746:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.800753:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.800759:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.800764:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.800995:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801005:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801010:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801015:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801020:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801025:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801043:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801050:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801060:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801067:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801072:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801096:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801112:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801117:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801123:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801128:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801133:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801139:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801155:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801160:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801166:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801172:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801182:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801188:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801193:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801199:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801206:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801213:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801219:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801225:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801246:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801252:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801258:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801264:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801270:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801276:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801282:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801288:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801294:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801299:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801305:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801323:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801344:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801350:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801356:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801362:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.801376:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756291.811514:0:5810:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9d3c500d7400:5810] 0 exiting: rc = 1 00000100:00100000:1.0:1782756291.811768:0:5811:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9d3c4abc7e00:5811] 1 exiting: rc = 0 00000100:00100000:2.0:1782756291.811895:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.811903:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.811909:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.811914:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.811920:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.811927:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.811935:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.811943:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.811950:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.811957:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.811964:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.811972:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.811978:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.811988:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.811998:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812005:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812014:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812023:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812028:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812034:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812039:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812043:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812057:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812063:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812068:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812072:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812101:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812107:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812112:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812117:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812123:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812128:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812133:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812138:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812143:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812162:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812166:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812171:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812177:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812183:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812188:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812193:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812199:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812204:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812208:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812214:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812219:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812223:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812228:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812233:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812238:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.812988:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.813004:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.813013:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.813018:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.813022:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.813026:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.813031:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.813035:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.813040:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.813046:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.813052:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.813059:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.813065:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756291.814708:0:5813:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9d3c4abc7600:5813] 1 exiting: rc = 0 00000100:00100000:3.0:1782756291.814808:0:5812:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9d3c4abc7800:5812] 0 exiting: rc = 1 00000100:00100000:2.0:1782756291.814911:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.814918:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.814924:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.814929:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.814934:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.814940:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.814962:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.814968:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.814974:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.814980:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.814985:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.814990:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.814996:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815001:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815007:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815012:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815018:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815023:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815028:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815033:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815039:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815044:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815048:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815053:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815057:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815062:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815066:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815070:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815150:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815160:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815166:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815172:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815178:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815181:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815186:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815335:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815343:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815348:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815353:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815359:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815364:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815378:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815383:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815389:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815394:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815399:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815404:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815410:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815414:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815432:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815438:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815443:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815448:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815453:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815457:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815462:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815466:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815470:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815475:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815479:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815483:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815500:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815506:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.815511:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756291.816370:0:5814:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9d3c70468e00:5814] 0 exiting: rc = 1 00000100:00100000:0.0:1782756291.820383:0:5815:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9d3c70469800:5815] 1 exiting: rc = 0 00000100:00100000:2.0:1782756291.820458:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820476:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820488:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820500:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820510:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820520:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820530:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820540:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820552:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820563:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820574:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820585:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820607:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820703:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820713:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820733:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820744:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820755:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820765:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820776:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820784:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820791:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820799:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820857:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820863:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820870:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820874:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820877:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820881:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820890:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820896:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820901:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820907:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820912:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820917:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820923:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820927:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.820932:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.821006:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.821012:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.821016:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.821021:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.821026:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.821031:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.821036:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.821042:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.821047:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.821061:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.821066:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.821072:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.821157:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.821163:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.821168:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.821172:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.821194:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.821200:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.821204:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.821210:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.821216:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.821220:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.821226:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.821231:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.821236:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756291.821250:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.824470:0:5816:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9d3c497a4c00:5816] 0 exiting: rc = 1 00000100:00100000:3.0:1782756291.824657:0:5817:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9d3c497a4000:5817] 1 exiting: rc = 0 00000100:00100000:3.0:1782756291.824841:0:5818:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9d3c4abc6800:5818] 2 exiting: rc = 0 00000100:00100000:3.0:1782756291.824905:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.824913:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.824919:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.824925:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.824931:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.824937:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.824942:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.824948:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.824953:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.824959:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.824966:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.824971:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.824976:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.824982:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.824986:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.824991:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825004:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825010:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825031:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825038:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825043:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825048:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825053:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825058:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825063:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825068:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825097:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825105:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825110:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825127:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825134:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825139:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825145:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825150:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825156:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825161:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825167:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825173:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825188:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825196:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825202:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825207:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825233:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825240:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825246:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825252:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825257:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825262:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825267:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825272:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825277:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825283:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825289:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825295:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825301:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825307:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825312:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825318:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825324:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825330:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825335:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825341:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825347:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782756291.825352:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1782756291.834994:0:12916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782756291.835013:0:12916:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1782756291.835020:0:12916:0:(genops.c:906:class_export_put()) final put ffff9d3c4abba800/MDS_uuid 00000020:00000080:2.0:1782756291.835026:0:12916:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c4abba800/MDS_uuid for MDS 00000020:01000000:2.0:1782756291.835036:0:12916:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1782756291.835231:0:12916:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1782756292.044387:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756293.068149:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1782756293.972658:0:13072:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1782756293.991695:0:13072:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1782756293.991747:0:13072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41530200/0x5e4fb0a8aa198c00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198c07 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756293.991763:0:13072:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41530200/0x5e4fb0a8aa198c00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198c07 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756293.991771:0:13072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41530200/0x5e4fb0a8aa198c00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5e4fb0a8aa198c07 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756293.991778:0:13072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.125@tcp lock: ffff9d3c41530200/0x5e4fb0a8aa198c00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5e4fb0a8aa198c07 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756293.991846:0:13072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1782756293.991852:0:13072:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1782756293.991872:0:13072:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782756293.991877:0:13072:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1782756293.991905:0:13072:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1782756293.991929:0:13072:0:(import.c:65:import_set_state_nolock()) ffff9d3b4114c800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1782756293.991999:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1869355222642176:0@lo:39:umount.0 00000400:00000100:3.0:1782756293.992051:0:3313:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869355222642176 offset 0 length 224: 4 00010000:00010000:2.0:1782756293.992338:0:12917:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782756293.992346:0:12917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c41530200/0x5e4fb0a8aa198c00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5e4fb0a8aa198c07 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756293.992353:0:12917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41530200 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:2.0:1782756293.992356:0:12917:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41530200/0x5e4fb0a8aa198c00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5e4fb0a8aa198c07 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756293.992365:0:12917:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c41530200/0x5e4fb0a8aa198c00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x5e4fb0a8aa198c07 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782756293.992383:0:12917:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41530200/0x5e4fb0a8aa198c00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x5e4fb0a8aa198c07 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782756293.992390:0:12917:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1782756293.992393:0:12917:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1782756293.992395:0:12917:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1782756293.992419:0:12917:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c41530200/0x5e4fb0a8aa198c00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5e4fb0a8aa198c07 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756293.992425:0:12917:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1782756293.992482:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222642304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782756293.992526:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782756293.992796:0:12917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c41530200/0x5e4fb0a8aa198c00 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5e4fb0a8aa198c07 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756293.992805:0:12917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c41530200/0x5e4fb0a8aa198c00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5e4fb0a8aa198c07 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756293.992820:0:12917:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756293.992822:0:12917:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756293.992825:0:12917:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782756293.992946:0:8367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222642304 00000100:00100000:3.0:1782756293.992954:0:8367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222642304 00000100:00100000:3.0:1782756293.993034:0:8367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782756293.993043:0:8367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c501d5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3317:x1869355222642304:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1782756293.993050:0:8367:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782756293 with bad export cookie 6795844601180162267 00000100:00100000:2.0:1782756294.003005:0:8367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c501d5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3317:x1869355222642304:12345-0@lo:103:ldlm_bl.0 Request processed in 9955us (10473us total) trans 0 rc -107/-107 00000100:00100000:2.0:1782756294.003021:0:8367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1782756294.003332:0:3317:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.125@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1782756294.003338:0:3317:0:(import.c:65:import_set_state_nolock()) ffff9d3c4a6bd800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1782756294.003342:0:3317:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1782756294.009330:0:3317:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.125@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1782756294.009337:0:3317:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1782756294.009347:0:3317:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3c80fbb100 x1869355222642304/t0(0) o103->MGC192.168.204.125@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1782756309 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1782756294.009363:0:3317:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1782756294.009366:0:3317:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1782756294.009367:0:3317:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1782756294.009370:0:3317:0:(import.c:65:import_set_state_nolock()) ffff9d3c4a6bd800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782756294.009375:0:3317:0:(import.c:512:import_select_connection()) MGC192.168.204.125@tcp: connect to NID 0@lo last attempt 155 00000100:00080000:0.0:1782756294.009384:0:3317:0:(import.c:626:import_select_connection()) MGC192.168.204.125@tcp: import ffff9d3c4a6bd800 using connection 192.168.204.125@tcp/0@lo 00000100:00100000:0.0:1782756294.009419:0:3317:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3b419f8a80 x1869355222642432/t0(0) o250->MGC192.168.204.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782756294.009477:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0daec403-69b6-4c98-a0ea-f519ca0a480f:3313:1869355222642432:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:3.0:1782756294.009530:0:3313:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869355222642432 offset 0 length 520: 4 00000100:00100000:0.0:1782756294.009613:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0daec403-69b6-4c98-a0ea-f519ca0a480f:3317:1869355222642304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782756294.092330:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869355222642560:0@lo:400:kworker.0 00000400:00000100:1.0:1782756294.092388:0:3314:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869355222642560 offset 0 length 224: 4 00010000:00010000:0.0:1782756294.092772:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756295.116588:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756296.140398:0:12917:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756297.164592:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756298.189792:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782756299.212365:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) 0daec403-69b6-4c98-a0ea-f519ca0a480f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1782756299.212380:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) 0daec403-69b6-4c98-a0ea-f519ca0a480f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782756299.212675:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869355222642688:0@lo:400:kworker.0 00000400:00000100:2.0:1782756299.212759:0:3315:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869355222642688 offset 0 length 224: 4 00010000:00010000:0.0:1782756299.213002:0:12917:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756300.236677:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756301.262041:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756302.285061:0:12917:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782756303.180268:0:3313:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782756293/real 1782756293] req@ffff9d3c78e2bb80 x1869355222642176/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782756303 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756303.180310:0:3313:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d3c78e2bb80 x1869355222642176/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782756303 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782756303.180328:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9d3b4114c800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1782756303.180349:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1869355222642176:0@lo:39:umount.0 00000100:00080000:1.0:1782756303.180393:0:13072:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782756303.180399:0:13072:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1782756303.180404:0:13072:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1782756303.181366:0:13072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198c0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198c15 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756303.181380:0:13072:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198c0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198c15 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756303.181387:0:13072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198c0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5e4fb0a8aa198c15 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756303.181394:0:13072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198c0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5e4fb0a8aa198c15 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756303.181421:0:13072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782756303.181429:0:13072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198e30 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198e37 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756303.181436:0:13072:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198e30 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198e37 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756303.181443:0:13072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198e30 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5e4fb0a8aa198e37 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756303.181470:0:13072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198e30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5e4fb0a8aa198e37 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756303.181492:0:13072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1782756303.181505:0:13072:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1782756303.181527:0:13072:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1782756303.181531:0:13072:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1782756303.181536:0:13072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782756303.181540:0:13072:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1782756303.181544:0:13072:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9d3c44d18000) has no exports 00000020:00080000:1.0:1782756303.181569:0:13072:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9d3c44d18000) has no exports 00010000:00010000:3.0:1782756303.181574:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782756303.181583:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198c0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5e4fb0a8aa198c15 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756303.181602:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41530c00 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:3.0:1782756303.181606:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198c0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5e4fb0a8aa198c15 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756303.181615:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198c0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5e4fb0a8aa198c15 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782756303.181621:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198c0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5e4fb0a8aa198c15 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782756303.181626:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782756303.181629:0:5792:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1782756303.181632:0:5792:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1782756303.181660:0:5792:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d3c4a6bd800 00010000:00010000:3.0:1782756303.181665:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198c0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5e4fb0a8aa198c15 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756303.181672:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c41530c00/0x5e4fb0a8aa198c0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5e4fb0a8aa198c15 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756303.181687:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756303.181690:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198e30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5e4fb0a8aa198e37 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756303.181695:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41496600 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:3.0:1782756303.181697:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198e30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5e4fb0a8aa198e37 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756303.181704:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198e30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5e4fb0a8aa198e37 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782756303.181730:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198e30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5e4fb0a8aa198e37 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782756303.181736:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1782756303.181738:0:5792:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1782756303.181740:0:5792:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1782756303.181758:0:5792:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d3c4a6bd800 00010000:00010000:3.0:1782756303.181762:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198e30 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5e4fb0a8aa198e37 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756303.181768:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c41496600/0x5e4fb0a8aa198e30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5e4fb0a8aa198e37 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756303.181780:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756303.181781:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756303.181783:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756303.182246:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1782756303.183148:0:13072:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d3c48e98780 - data ffff9d3c64c1c360/ffff9d3c7fb5f800 00000020:01000000:1.0:1782756303.183276:0:13072:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d3c465335a0 - data ffff9d3c65baebd0/ffff9d3b41195800 00100000:10000000:1.0:1782756303.194594:0:13072:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1782756303.233809:0:13072:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa198a01 00000020:00000080:0.0:1782756303.233817:0:13072:0:(genops.c:906:class_export_put()) final put ffff9d3c7fc65000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1782756303.233827:0:13072:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d3c4a734800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1782756303.233829:0:13072:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9d3c4a734800 2 00000020:01000004:0.0:1782756303.233832:0:13072:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d3c4a734800 from lustre-OST0000 00000020:00000080:0.0:1782756303.233857:0:13072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782756303.233865:0:13072:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1782756303.233867:0:13072:0:(genops.c:906:class_export_put()) final put ffff9d3c4a74f800/lustre-OST0000_UUID 00000020:00000080:0.0:1782756303.233869:0:13072:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c4a74f800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1782756303.233877:0:13072:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1782756303.233909:0:13072:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1782756303.233912:0:13072:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1782756303.233915:0:13072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782756303.233918:0:13072:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1782756303.233923:0:13072:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9d3b4114c000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1782756303.233927:0:13072:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9d3c50023380) has exports, disconnecting them 00000020:00080000:0.0:1782756303.233930:0:13072:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9d3b4114c000), last request at 1782756125 00000020:00000080:0.0:1782756303.233933:0:13072:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa198a2b 00000020:00080000:0.0:1782756303.233939:0:13072:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d3b4114c000): rc 0 00000020:00000080:0.0:1782756303.233943:0:13072:0:(genops.c:906:class_export_put()) final put ffff9d3b4114c000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1782756303.234677:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c7fc65000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1782756303.234693:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3b4114c000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1782756303.236157:0:13072:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1782756303.236165:0:13072:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782756303.236169:0:13072:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1782756303.236318:0:13072:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1782756303.236473:0:13072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782756303.236482:0:13072:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1782756303.236488:0:13072:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9d3c4a734800 1 00000020:00000080:2.0:1782756303.236494:0:13072:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa1989bb 00000020:00000080:2.0:1782756303.236513:0:13072:0:(genops.c:906:class_export_put()) final put ffff9d3c4a6fc000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1782756303.236520:0:13072:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1782756303.236524:0:13072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782756303.236528:0:13072:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1782756303.236532:0:13072:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9d3c76f03380) has no exports 00000020:00000080:3.0:1782756303.236594:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d3b4114c800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1782756303.236601:0:36:0:(genops.c:906:class_export_put()) final put ffff9d3b4114b800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1782756303.236604:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3b4114b800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1782756303.236609:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1782756303.236672:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c4a6fc000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1782756303.250898:0:13072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782756303.250911:0:13072:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1782756303.250917:0:13072:0:(genops.c:906:class_export_put()) final put ffff9d3c4a732800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1782756303.250921:0:13072:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c4a732800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1782756303.250930:0:13072:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1782756303.251061:0:13072:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9d3c4a734000 00000020:02000400:2.0:1782756303.252993:0:13072:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1782756303.310488:0:12917:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782756304.204202:0:3313:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782756294/real 1782756294] req@ffff9d3b419f8a80 x1869355222642432/t0(0) o250->MGC192.168.204.125@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782756304 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756304.204237:0:3313:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d3b419f8a80 x1869355222642432/t0(0) o250->MGC192.168.204.125@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782756304 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782756304.204294:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9d3c4a6bd800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782756304.204319:0:3313:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1782756304.204324:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0daec403-69b6-4c98-a0ea-f519ca0a480f:3313:1869355222642432:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:0.0:1782756304.204416:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) 0daec403-69b6-4c98-a0ea-f519ca0a480f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782756304.204421:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1782756304.204424:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d3c4a6bd800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782756304.204429:0:36:0:(import.c:512:import_select_connection()) MGC192.168.204.125@tcp: connect to NID 0@lo last attempt 335 00000100:00080000:0.0:1782756304.204434:0:36:0:(import.c:591:import_select_connection()) MGC192.168.204.125@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1782756304.204440:0:36:0:(import.c:626:import_select_connection()) MGC192.168.204.125@tcp: import ffff9d3c4a6bd800 using connection 192.168.204.125@tcp/0@lo 00000100:00100000:0.0:1782756304.204470:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3b419f8a80 x1869355222642816/t0(0) o250->MGC192.168.204.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782756304.204595:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0daec403-69b6-4c98-a0ea-f519ca0a480f:3313:1869355222642816:0@lo:250:kworker.0 00000400:00000100:3.0:1782756304.204646:0:3313:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869355222642816 offset 0 length 520: 4 00000100:00100000:2.0:1782756304.205340:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782756304.205353:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869355222642944:0@lo:400:kworker.0 00000400:00000100:2.0:1782756304.205382:0:3317:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869355222642944 offset 0 length 224: 4 00010000:00010000:1.0:1782756304.332440:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1782756305.155640:0:13224:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1782756305.167492:0:13224:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1782756305.167733:0:13224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41497800/0x5e4fb0a8aa198be4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198beb expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756305.167752:0:13224:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41497800/0x5e4fb0a8aa198be4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198beb expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756305.167761:0:13224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41497800/0x5e4fb0a8aa198be4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5e4fb0a8aa198beb expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756305.167768:0:13224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.125@tcp lock: ffff9d3c41497800/0x5e4fb0a8aa198be4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5e4fb0a8aa198beb expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756305.167799:0:13224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1782756305.167805:0:13224:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1782756305.167841:0:13224:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782756305.167853:0:13224:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3b419f9500 x1869355222642560/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782756310 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756305.167874:0:13224:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3c78e10700 x1869355222642688/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782756315 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756305.167883:0:13224:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3b419faa00 x1869355222642944/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782756320 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756305.167890:0:13224:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1782756305.167895:0:13224:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1782756305.167916:0:13224:0:(import.c:65:import_set_state_nolock()) ffff9d3b41d9d000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1782756305.168434:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782756305.168443:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c41497800/0x5e4fb0a8aa198be4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5e4fb0a8aa198beb expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756305.168453:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41497800 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:2.0:1782756305.168457:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41497800/0x5e4fb0a8aa198be4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5e4fb0a8aa198beb expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756305.168476:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c41497800/0x5e4fb0a8aa198be4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5e4fb0a8aa198beb expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782756305.168484:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41497800/0x5e4fb0a8aa198be4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5e4fb0a8aa198beb expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782756305.168504:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1782756305.168506:0:5791:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1782756305.168509:0:5791:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1782756305.168523:0:5791:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d3c4a6bd800 00010000:00010000:2.0:1782756305.168527:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c41497800/0x5e4fb0a8aa198be4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5e4fb0a8aa198beb expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756305.168533:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c41497800/0x5e4fb0a8aa198be4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5e4fb0a8aa198beb expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756305.168555:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756305.168557:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756305.168559:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782756305.168588:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869355222642688:0@lo:400:kworker.0 00000100:00100000:2.0:1782756305.168620:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869355222642944:0@lo:400:kworker.0 00000100:00100000:3.0:1782756305.169415:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869355222642560:0@lo:400:kworker.0 00000100:00100000:3.0:1782756305.169498:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1869355222643072:0@lo:39:umount.0 00000400:00000100:3.0:1782756305.169574:0:3313:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869355222643072 offset 0 length 224: 4 00010000:00010000:1.0:1782756305.356737:0:12917:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756306.381697:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756307.404543:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756308.428894:0:12917:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782756309.452369:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) 0daec403-69b6-4c98-a0ea-f519ca0a480f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782756309.452388:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) 0daec403-69b6-4c98-a0ea-f519ca0a480f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1782756309.453413:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756310.477124:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756311.500393:0:12917:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756312.524425:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756313.548365:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782756314.572273:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) 0daec403-69b6-4c98-a0ea-f519ca0a480f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1782756314.572292:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) 0daec403-69b6-4c98-a0ea-f519ca0a480f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1782756314.575539:0:12917:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782756315.340286:0:3313:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782756305/real 1782756305] req@ffff9d3b419f9c00 x1869355222643072/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782756315 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756315.340323:0:3313:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d3b419f9c00 x1869355222643072/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782756315 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782756315.340463:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9d3b41d9d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1782756315.340537:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1869355222643072:0@lo:39:umount.0 00000100:00080000:0.0:1782756315.342501:0:13224:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782756315.342509:0:13224:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1782756315.342517:0:13224:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1782756315.344049:0:13224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b200/0x5e4fb0a8aa198bf2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198bf9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756315.344152:0:13224:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b200/0x5e4fb0a8aa198bf2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198bf9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756315.344160:0:13224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b200/0x5e4fb0a8aa198bf2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5e4fb0a8aa198bf9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756315.344166:0:13224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b200/0x5e4fb0a8aa198bf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5e4fb0a8aa198bf9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756315.344379:0:13224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782756315.344389:0:13224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81a400/0x5e4fb0a8aa198e22 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa198e29 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756315.344395:0:13224:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81a400/0x5e4fb0a8aa198e22 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa198e29 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756315.344400:0:13224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81a400/0x5e4fb0a8aa198e22 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5e4fb0a8aa198e29 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756315.344407:0:13224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81a400/0x5e4fb0a8aa198e22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5e4fb0a8aa198e29 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756315.345160:0:13224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1782756315.345181:0:13224:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:2.0:1782756315.345251:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782756315.345270:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b200/0x5e4fb0a8aa198bf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5e4fb0a8aa198bf9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756315.345280:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81b200 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:2.0:1782756315.345284:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b200/0x5e4fb0a8aa198bf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5e4fb0a8aa198bf9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756315.345295:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b200/0x5e4fb0a8aa198bf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5e4fb0a8aa198bf9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782756315.345314:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b200/0x5e4fb0a8aa198bf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5e4fb0a8aa198bf9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782756315.345320:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1782756315.345323:0:5791:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1782756315.345325:0:5791:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00000020:01000004:0.0:1782756315.345334:0:13224:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1782756315.345340:0:13224:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1782756315.345346:0:13224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782756315.345352:0:13224:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1782756315.345355:0:13224:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9d3c500219c0) has no exports 00000020:00080000:0.0:1782756315.345381:0:13224:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9d3c500219c0) has no exports 00010000:00010000:2.0:1782756315.345458:0:5791:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d3c4a6bd800 00010000:00010000:2.0:1782756315.345463:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b200/0x5e4fb0a8aa198bf2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5e4fb0a8aa198bf9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756315.345471:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81b200/0x5e4fb0a8aa198bf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5e4fb0a8aa198bf9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756315.345486:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782756315.345489:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81a400/0x5e4fb0a8aa198e22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5e4fb0a8aa198e29 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756315.345495:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4b81a400 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:2.0:1782756315.345498:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81a400/0x5e4fb0a8aa198e22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5e4fb0a8aa198e29 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756315.345506:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81a400/0x5e4fb0a8aa198e22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5e4fb0a8aa198e29 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782756315.345513:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81a400/0x5e4fb0a8aa198e22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5e4fb0a8aa198e29 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782756315.345518:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1782756315.345520:0:5791:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1782756315.345527:0:5791:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1782756315.345534:0:5791:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d3c4a6bd800 00010000:00010000:2.0:1782756315.345537:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81a400/0x5e4fb0a8aa198e22 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5e4fb0a8aa198e29 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756315.345543:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c4b81a400/0x5e4fb0a8aa198e22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5e4fb0a8aa198e29 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756315.345555:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756315.345557:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756315.345559:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756315.345596:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1782756315.348062:0:13224:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d3c450952a0 - data ffff9d3c64c4baf8/ffff9d3c7fb5d800 00000020:01000000:0.0:1782756315.348315:0:13224:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d3c4b992720 - data ffff9d3c64fa1438/ffff9d3c80c2a000 00100000:10000000:0.0:1782756315.360195:0:13224:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1782756315.383532:0:13224:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa198ada 00000020:00000080:1.0:1782756315.383545:0:13224:0:(genops.c:906:class_export_put()) final put ffff9d3c77030800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1782756315.383623:0:13224:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d3c80977000 from lustre-OST0001, refs=2 00000020:00000080:2.0:1782756315.383624:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c77030800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000004:1.0:1782756315.383637:0:13224:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9d3c80977000 2 00000020:01000004:1.0:1782756315.383642:0:13224:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d3c80977000 from lustre-OST0001 00000020:00000080:1.0:1782756315.383669:0:13224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782756315.383679:0:13224:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1782756315.383682:0:13224:0:(genops.c:906:class_export_put()) final put ffff9d3c77033000/lustre-OST0001_UUID 00000020:00000080:1.0:1782756315.383684:0:13224:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c77033000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1782756315.383694:0:13224:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1782756315.384041:0:13224:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import 0daec403-69b6-4c98-a0ea-f519ca0a480f->MGS 00010000:00010000:1.0:1782756315.384063:0:13224:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c4168dc00/0x5e4fb0a8aa1989de lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5e4fb0a8aa1989e5 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782756315.384106:0:13224:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4168dc00/0x5e4fb0a8aa1989de lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5e4fb0a8aa1989e5 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756315.384113:0:13224:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1782756315.384116:0:13224:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1782756315.384121:0:13224:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1782756315.384137:0:13224:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d3c4a6bd800 00010000:00010000:1.0:1782756315.384142:0:13224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c4168dc00/0x5e4fb0a8aa1989de lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5e4fb0a8aa1989e5 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756315.384161:0:13224:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c41497c00/0x5e4fb0a8aa198c38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5e4fb0a8aa198c3f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782756315.384169:0:13224:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c41497c00/0x5e4fb0a8aa198c38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5e4fb0a8aa198c3f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756315.384179:0:13224:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1782756315.384182:0:13224:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1782756315.384183:0:13224:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1782756315.384193:0:13224:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d3c4a6bd800 00010000:00010000:1.0:1782756315.384202:0:13224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c41497c00/0x5e4fb0a8aa198c38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5e4fb0a8aa198c3f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782756315.384277:0:13224:0:(import.c:65:import_set_state_nolock()) ffff9d3c4a6bd800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1782756315.384282:0:13224:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1782756315.384284:0:13224:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1782756315.384286:0:13224:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1782756315.384295:0:13224:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1782756315.384305:0:13224:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d3b419f8a80 x1869355222642816/t0(0) o250->MGC192.168.204.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1782756319 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1782756315.384358:0:13224:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1782756315.384361:0:13224:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00100000:2.0:1782756315.384377:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0daec403-69b6-4c98-a0ea-f519ca0a480f:3313:1869355222642816:0@lo:250:kworker.0 10000000:01000000:1.0:1782756315.384465:0:13224:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1782756315.384473:0:13224:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa1988cd 00000020:00000080:1.0:1782756315.384479:0:13224:0:(genops.c:906:class_export_put()) final put ffff9d3c4abba000/0daec403-69b6-4c98-a0ea-f519ca0a480f 00000020:01000000:1.0:1782756315.384495:0:13224:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.204.125@tcp (flags='') 00000020:00000080:1.0:1782756315.384500:0:13224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782756315.384505:0:13224:0:(obd_config.c:955:class_cleanup()) MGC192.168.204.125@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1782756315.384509:0:13224:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9d3c4aba3380) has no exports 00000020:00000080:2.0:1782756315.384535:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c4abba000/0daec403-69b6-4c98-a0ea-f519ca0a480f for MGC192.168.204.125@tcp 10000000:01000000:0.0:1782756315.384563:0:5800:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1782756315.384716:0:13224:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.204.125@tcp: client import never connected 00000100:00080000:1.0:1782756315.384720:0:13224:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1782756315.384722:0:13224:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1782756315.384724:0:13224:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1782756315.384726:0:13224:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1782756315.384832:0:13224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782756315.384838:0:13224:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.125@tcp (uuid 0daec403-69b6-4c98-a0ea-f519ca0a480f) 00000020:01000000:1.0:1782756315.384843:0:13224:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1782756315.384846:0:13224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782756315.384849:0:13224:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1782756315.384854:0:13224:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9d3b41d9e800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782756315.384859:0:13224:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff9d3c4aba0000) has exports, disconnecting them 00000020:00080000:1.0:1782756315.384864:0:13224:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9d3b41d9e800), last request at 1782756138 00000020:00000080:1.0:1782756315.384874:0:13224:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa198b04 00000020:00080000:1.0:1782756315.384892:0:13224:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d3b41d9e800): rc 0 00000020:00000080:1.0:1782756315.384901:0:13224:0:(genops.c:906:class_export_put()) final put ffff9d3b41d9e800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1782756315.385418:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d3c4a6bd800 for MGC192.168.204.125@tcp 00000020:00000080:2.0:1782756315.385428:0:8:0:(genops.c:906:class_export_put()) final put ffff9d3c4a6bc800/0daec403-69b6-4c98-a0ea-f519ca0a480f 00000020:00000080:2.0:1782756315.385431:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c4a6bc800/0daec403-69b6-4c98-a0ea-f519ca0a480f for MGC192.168.204.125@tcp 00000020:01000000:2.0:1782756315.385438:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.125@tcp (0daec403-69b6-4c98-a0ea-f519ca0a480f) 00000020:00000080:2.0:1782756315.387299:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3b41d9e800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1782756315.390148:0:13224:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1782756315.390157:0:13224:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782756315.390162:0:13224:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1782756315.390169:0:13224:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1782756315.390302:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d3b41d9d000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1782756315.415331:0:12917:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1782756315.416312:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1782756315.416451:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1782756315.416794:0:8366:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9d3c78ef6c00:8366] 2 exiting: rc = 0 00000100:00100000:0.0:1782756315.416865:0:5787:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9d3c4b933400:5787] 1 exiting: rc = 0 00000100:00100000:1.0:1782756315.417304:0:5786:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9d3c4b933600:5786] 0 exiting: rc = 1 00000100:00100000:2.0:1782756315.417463:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.417758:0:8367:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9d3c44c44000:8367] 3 exiting: rc = 0 00000100:00100000:0.0:1782756315.417815:0:5789:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9d3c44e3e600:5789] 1 exiting: rc = 0 00000100:00100000:2.0:1782756315.417818:0:5788:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9d3c4b932000:5788] 0 exiting: rc = 1 00000100:00100000:1.0:1782756315.418576:0:5790:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9d3c44e3f600:5790] 2 exiting: rc = 0 00000100:00100000:2.0:1782756315.418714:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.418721:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.418851:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.418956:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.418963:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.418968:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.418986:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.418993:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.418998:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.419004:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.419016:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.419024:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.419033:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.419042:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.419052:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.419901:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.419914:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.419921:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.419929:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.419936:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.419943:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.419947:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.419952:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.419958:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.419963:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.419968:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.419974:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.419979:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.419985:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.419991:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.419996:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420001:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420007:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420012:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420017:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420022:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420027:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420033:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420038:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420043:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420048:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420062:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420067:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420099:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420106:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420111:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420116:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420120:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420125:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420129:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420134:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420139:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420144:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420149:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420154:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420159:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420164:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420169:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420175:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420180:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420185:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420190:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420195:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.420211:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1782756315.421609:0:13224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782756315.421620:0:13224:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1782756315.421625:0:13224:0:(genops.c:906:class_export_put()) final put ffff9d3c78a3d000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1782756315.421630:0:13224:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c78a3d000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1782756315.421635:0:13224:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1782756315.421679:0:13224:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9d3c80977000 1 00000020:00000080:2.0:1782756315.421684:0:13224:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5e4fb0a8aa198aa9 00000020:00000080:2.0:1782756315.421690:0:13224:0:(genops.c:906:class_export_put()) final put ffff9d3c4abbf800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1782756315.421711:0:13224:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1782756315.421716:0:13224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782756315.421720:0:13224:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1782756315.421731:0:13224:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9d3c76f04d40) has no exports 00000020:00000080:0.0:1782756315.421994:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c4abbf800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1782756315.452643:0:13224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782756315.452659:0:13224:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1782756315.452665:0:13224:0:(genops.c:906:class_export_put()) final put ffff9d3c7fa7d000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1782756315.452671:0:13224:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c7fa7d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1782756315.452757:0:13224:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1782756315.452951:0:13224:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9d3c7fa79800 00000020:01000000:0.0:1782756315.452971:0:13224:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1782756315.452975:0:13224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782756315.452978:0:13224:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1782756315.452982:0:13224:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9d3c4aba19c0) has no exports 00000020:00000080:0.0:1782756315.453012:0:13224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782756315.453018:0:13224:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1782756315.453021:0:13224:0:(genops.c:906:class_export_put()) final put ffff9d3c4a6fe800/OSS_uuid 00000020:00000080:0.0:1782756315.453023:0:13224:0:(genops.c:865:class_export_destroy()) destroying export ffff9d3c4a6fe800/OSS_uuid for OSS 00000020:01000000:0.0:1782756315.453027:0:13224:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1782756315.453176:0:10416:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9d3c4b994c00:10416] 3 exiting: rc = 0 00000100:00100000:2.0:1782756315.453368:0:6602:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9d3c455af200:6602] 0 exiting: rc = 1 00000100:00080000:3.0:1782756315.453470:0:5799:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1782756315.454142:0:6605:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9d3c4b994200:6605] 2 exiting: rc = 0 00000100:00100000:0.0:1782756315.456173:0:6603:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9d3c455afa00:6603] 1 exiting: rc = 0 00000100:00100000:2.0:1782756315.456368:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456377:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456384:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456391:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456397:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456403:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456409:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456414:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456419:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456424:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456429:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456433:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456438:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456443:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456447:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456452:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456457:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456463:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456468:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456472:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456477:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456482:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456487:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456492:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456496:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456501:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456506:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456510:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456514:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456519:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456524:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456529:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456533:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456565:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456571:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456576:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456581:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456586:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456591:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456595:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456600:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456604:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456610:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456614:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456619:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456624:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456629:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456633:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456638:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456643:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456648:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456653:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456658:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456663:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456671:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456692:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456698:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456704:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456709:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456714:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456719:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456724:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456729:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.456734:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.457693:0:8071:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9d3c500dd000:8071] 2 exiting: rc = 0 00000100:00100000:3.0:1782756315.458058:0:6607:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9d3c4b8a3200:6607] 1 exiting: rc = 0 00000100:00100000:0.0:1782756315.458244:0:6606:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9d3c4b8a3c00:6606] 0 exiting: rc = 1 00000100:00100000:2.0:1782756315.460936:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.460946:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.460952:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.460957:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.460978:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.460983:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.460989:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.460994:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461000:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461005:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461011:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461016:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461022:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461028:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461034:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461039:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461044:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461050:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461055:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461062:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461321:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461329:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461333:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461338:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461343:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461348:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461353:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461359:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461364:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461369:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461375:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461380:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461385:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461390:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461396:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461401:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461408:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461413:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461419:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461434:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461439:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461445:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461450:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461456:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461461:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461467:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461473:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461478:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461484:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461489:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461494:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461499:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461504:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461509:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461513:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461518:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461523:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461528:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461533:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461538:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461542:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461547:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461552:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.461563:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.463004:0:6608:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9d3c78a5d200:6608] 0 exiting: rc = 1 00000100:00100000:1.0:1782756315.464588:0:6609:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9d3c78a5d400:6609] 1 exiting: rc = 0 00000100:00100000:3.0:1782756315.466404:0:6610:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9d3c78a5da00:6610] 2 exiting: rc = 0 00000100:00100000:1.0:1782756315.466594:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.466602:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.466606:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.466611:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.466616:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.466622:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.466626:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.466631:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.466636:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.466641:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.466649:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.466655:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.466660:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.466664:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.466669:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.466674:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.466688:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.466693:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.466706:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.466713:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.466718:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.466723:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.466727:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.466732:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467059:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467108:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467201:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467207:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467214:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467220:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467226:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467232:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467237:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467243:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467250:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467265:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467272:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467281:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467291:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467299:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467304:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467311:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467334:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467339:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467347:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467352:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467357:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467441:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467448:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467453:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467459:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467464:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467469:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467474:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467478:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467484:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467492:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467498:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467504:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467509:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467514:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467525:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467533:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.467545:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.475406:0:6611:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9d3c78af7600:6611] 0 exiting: rc = 1 00000100:00100000:3.0:1782756315.475569:0:6612:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9d3c78af7400:6612] 1 exiting: rc = 0 00000100:00100000:0.0:1782756315.475761:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475769:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475774:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475780:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475786:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475792:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475797:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475803:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475809:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475814:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475820:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475825:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475830:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475836:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475843:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475848:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475853:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475858:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475863:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475869:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475875:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475881:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475885:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475906:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475911:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475917:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475922:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475928:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475934:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475940:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475945:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475950:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475955:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475960:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475965:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475971:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475981:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475987:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475993:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.475999:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.476004:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.476008:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.476014:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.476019:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.476024:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.476029:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.476042:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.476049:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.476054:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.476059:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.476064:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.476070:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.476406:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.476415:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.476420:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.476425:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.476430:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.476435:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.476448:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.476454:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.476458:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.476463:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.476468:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782756315.476473:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782756315.481788:0:6614:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9d3c78af7000:6614] 1 exiting: rc = 0 00000100:00100000:3.0:1782756315.481959:0:6613:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9d3c78af6000:6613] 0 exiting: rc = 1 00000100:00100000:1.0:1782756315.482028:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482037:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482048:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482054:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482060:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482069:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482105:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482116:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482126:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482137:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482144:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482152:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482177:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482185:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482190:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482196:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482205:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482211:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482217:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482223:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482320:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482332:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482339:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482345:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482368:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482377:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482385:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482395:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482401:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482408:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482416:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482422:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482442:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482447:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482453:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482458:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482480:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482489:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482495:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482501:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482507:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482591:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482601:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482607:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482614:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482621:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482629:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482639:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482666:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482677:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482684:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482693:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482704:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482712:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482719:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482726:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482732:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482738:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482744:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482750:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482779:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482787:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482792:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782756315.482799:0:13224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1782756315.491871:0:13224:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1782756327.334378:0:13841:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1782756332.555031:0:14254:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1782756332.555037:0:14254:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1782756332.555571:0:14254:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9d3c7fb26000 00000020:01000004:1.0:1782756332.555588:0:14254:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1782756332.555608:0:14254:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1782756332.555623:0:14254:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9d3c4aba19c0) 00000020:00000080:1.0:1782756332.555636:0:14254:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1782756332.574179:0:14254:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1782756332.576341:0:14254:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1782756332.576870:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1782756332.576976:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1782756332.577069:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:2.0:1782756332.577334:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:2.0:1782756332.577589:0:14254:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1782756332.577658:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:2.0:1782756332.578054:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1782756332.578490:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:2.0:1782756332.581789:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 643: rc = 0 00100000:10000000:2.0:1782756332.581893:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 643: rc = 0 00100000:10000000:2.0:1782756332.582639:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 592: rc = 0 00100000:10000000:2.0:1782756332.582898:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 592: rc = 0 00100000:10000000:2.0:1782756332.583354:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 592: rc = 0 00100000:10000000:2.0:1782756332.583797:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 592: rc = 0 00100000:10000000:2.0:1782756332.584059:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 592: rc = 0 00100000:10000000:2.0:1782756332.587626:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 592: rc = 0 00100000:10000000:2.0:1782756332.588010:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 592: rc = 0 00100000:10000000:2.0:1782756332.588972:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 592: rc = 0 00100000:10000000:2.0:1782756332.589575:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 592: rc = 0 00100000:10000000:2.0:1782756332.590018:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 592: rc = 0 00100000:10000000:2.0:1782756332.590335:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 592: rc = 0 00100000:10000000:2.0:1782756332.590627:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 592: rc = 0 00100000:10000000:2.0:1782756332.591305:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 613: rc = 0 00100000:10000000:2.0:1782756332.591599:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 613: rc = 0 00100000:10000000:2.0:1782756332.592325:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 613: rc = 0 00100000:10000000:2.0:1782756332.592607:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 613: rc = 0 00100000:10000000:2.0:1782756332.592993:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 613: rc = 0 00100000:10000000:2.0:1782756332.593370:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 613: rc = 0 00100000:10000000:2.0:1782756332.593656:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 613: rc = 0 00100000:10000000:2.0:1782756332.594026:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 613: rc = 0 00100000:10000000:2.0:1782756332.594389:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 613: rc = 0 00100000:10000000:2.0:1782756332.595275:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 613: rc = 0 00100000:10000000:2.0:1782756332.595518:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 613: rc = 0 00100000:10000000:2.0:1782756332.595784:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 613: rc = 0 00100000:10000000:2.0:1782756332.596021:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 613: rc = 0 00100000:10000000:2.0:1782756332.596271:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 613: rc = 0 00100000:10000000:2.0:1782756332.596479:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 613: rc = 0 00100000:10000000:2.0:1782756332.596703:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 613: rc = 0 00100000:10000000:2.0:1782756332.596920:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 613: rc = 0 00100000:10000000:2.0:1782756332.598837:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 613: rc = 0 00100000:10000000:2.0:1782756332.599127:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 613: rc = 0 00100000:10000000:2.0:1782756332.599375:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 613: rc = 0 00100000:10000000:2.0:1782756332.599618:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 613: rc = 0 00100000:10000000:2.0:1782756332.599859:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 613: rc = 0 00100000:10000000:2.0:1782756332.600134:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 613: rc = 0 00100000:10000000:2.0:1782756332.600376:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 613: rc = 0 00100000:10000000:2.0:1782756332.600605:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 613: rc = 0 00100000:10000000:2.0:1782756332.600857:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 613: rc = 0 00100000:10000000:2.0:1782756332.601056:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 613: rc = 0 00100000:10000000:2.0:1782756332.601250:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 613: rc = 0 00100000:10000000:2.0:1782756332.601424:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 613: rc = 0 00100000:10000000:2.0:1782756332.601828:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 613: rc = 0 00100000:10000000:2.0:1782756332.602119:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 613: rc = 0 00100000:10000000:2.0:1782756332.602341:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 613: rc = 0 00100000:10000000:2.0:1782756332.602709:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 648: rc = 0 00100000:10000000:2.0:1782756332.603263:0:14254:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1782756332.603440:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 644: rc = 0 00100000:10000000:2.0:1782756332.603782:0:14254:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1782756332.603851:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 644: rc = 0 00100000:10000000:2.0:1782756332.604046:0:14254:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1782756332.604191:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 644: rc = 0 00100000:10000000:2.0:1782756332.604536:0:14254:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1782756332.604605:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 771: rc = 0 00100000:10000000:2.0:1782756332.604941:0:14254:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1782756332.605016:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 771: rc = 0 00100000:10000000:2.0:1782756332.605237:0:14254:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1782756332.605365:0:14254:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 771: rc = 0 00000020:00000080:2.0:1782756332.605678:0:14254:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1782756332.605684:0:14254:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782756332.605692:0:14254:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5e4fb0a8aa199bce 00000020:01000004:2.0:1782756332.605700:0:14254:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1782756332.605703:0:14254:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1782756332.605707:0:14254:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d3c7fb26000 from MGS 00000020:01000004:2.0:1782756332.605710:0:14254:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1782756332.605717:0:14254:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9d3c44d199c0) 00000020:00000080:2.0:1782756332.605724:0:14254:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1782756332.605773:0:14254:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3c7fb26000 from MGS, refs=2 00080000:01000000:2.0:1782756332.605778:0:14254:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782756332.605783:0:14254:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5e4fb0a8aa199bdc 00000100:00100000:2.0:1782756332.605871:0:14254:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1782756332.605996:0:14254:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1782756332.606003:0:14254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1782756332.606521:0:14254:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1782756332.606530:0:14254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1782756332.607413:0:14254:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782756332.607560:0:14254:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1782756332.607571:0:14254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1782756332.608135:0:14254:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1782756332.608142:0:14254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1782756332.608753:0:14254:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1782756332.608762:0:14254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1782756332.609491:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756332.609495:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756332.609497:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756332.609954:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756332.609957:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756332.609959:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756332.610580:0:14254:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1782756332.613200:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1782756332.619286:0:14254:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1782756332.619303:0:14254:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1782756332.619306:0:14254:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1782756332.622411:0:14263:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1782756332.622692:0:14254:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1782756332.622810:0:14254:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1782756332.623401:0:14254:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1782756332.623699:0:14254:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782756332.623843:0:14254:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1782756332.623849:0:14254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1782756332.627469:0:14254:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1782756332.627485:0:14254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1782756332.630015:0:14254:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1782756332.630128:0:14254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1782756332.631744:0:14254:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1782756332.631767:0:14254:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.204.125@tcp' 00000020:01000004:3.0:1782756332.631769:0:14254:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1782756332.631797:0:14254:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.204.125@tcp (typ=mgc) 00000020:00000080:3.0:1782756332.631811:0:14254:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.125@tcp (ffff9d3c50023380) 00000020:00000080:3.0:1782756332.631827:0:14254:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1782756332.631907:0:14254:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3b42aff000@MGC192.168.204.125@tcp: add connection 192.168.204.125@tcp at head 00010000:00010000:3.0:1782756332.632156:0:14254:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.125@tcp-0 is initialized 00000040:01000000:3.0:1782756332.632163:0:14254:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.125@tcp ctxt 1 is initialized 00000100:00080000:1.0:1782756332.635164:0:14268:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1782756332.637882:0:14269:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1782756332.637964:0:14254:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.125@tcp (uuid 7c7873c7-f262-4959-b911-d0a7cf42af86) 00000020:00000080:1.0:1782756332.637987:0:14254:0:(genops.c:1406:class_connect()) connect: client 7c7873c7-f262-4959-b911-d0a7cf42af86, cookie 0x5e4fb0a8aa199bea 00000100:00080000:1.0:1782756332.637999:0:14254:0:(import.c:512:import_select_connection()) MGC192.168.204.125@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782756332.638005:0:14254:0:(import.c:626:import_select_connection()) MGC192.168.204.125@tcp: import ffff9d3b42aff000 using connection 192.168.204.125@tcp/0@lo 00000100:00100000:1.0:1782756332.638040:0:14254:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3c78e28a80 x1869355222643200/t0(0) o250->MGC192.168.204.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782756332.638065:0:14254:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 7c7873c7-f262-4959-b911-d0a7cf42af86->MGS 00000020:01000004:1.0:1782756332.638282:0:14254:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1782756332.638287:0:14254:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1782756332.638300:0:14254:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9d3c4aba0000) 00000020:00000080:1.0:1782756332.638310:0:14254:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1782756332.643822:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7c7873c7-f262-4959-b911-d0a7cf42af86:3313:1869355222643200:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1782756332.644017:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756332.648374:0:14254:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782756332.648657:0:14254:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1782756332.648664:0:14254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1782756332.649213:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222643200 00000100:00100000:3.0:1782756332.649227:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222643200 00000100:00100000:3.0:1782756332.649287:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782756332.649295:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80995850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3313:x1869355222643200:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1782756332.649329:0:14265:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 7c7873c7-f262-4959-b911-d0a7cf42af86@0@lo t0 exp 0000000000000000 cur 373 last 0 00000020:00000080:3.0:1782756332.649363:0:14265:0:(genops.c:1406:class_connect()) connect: client 7c7873c7-f262-4959-b911-d0a7cf42af86, cookie 0x5e4fb0a8aa199bf8 00000100:00080000:3.0:1782756332.649504:0:14265:0:(import.c:65:import_set_state_nolock()) ffff9d3b42afe800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782756332.649611:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80995850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+5:3313:x1869355222643200:12345-0@lo:250:mount.lustre.0 Request processed in 314us (5594us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756332.649618:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782756332.649954:0:14254:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1782756332.649962:0:14254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1782756332.650355:0:3313:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.204.125@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1782756332.650367:0:3313:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.204.125@tcp: connect to target with instance 0 00000100:00080000:1.0:1782756332.650375:0:3313:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.204.125@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1782756332.650382:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1782756332.650386:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9d3b42aff000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1782756332.650389:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1782756332.650412:0:3313:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1782756332.650420:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7c7873c7-f262-4959-b911-d0a7cf42af86:3313:1869355222643200:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1782756332.650623:0:14254:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1782756332.650630:0:14254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1782756332.651406:0:14254:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782756332.651589:0:14254:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1782756332.651595:0:14254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1782756332.652215:0:14254:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1782756332.652239:0:14254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1782756332.676936:0:14254:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782756332.677805:0:14254:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1782756332.677813:0:14254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1782756332.684815:0:14254:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1782756332.684830:0:14254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1782756332.685444:0:14254:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782756332.685604:0:14254:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1782756332.685609:0:14254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1782756332.686167:0:14254:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1782756332.686173:0:14254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1782756332.686623:0:14254:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782756332.686739:0:14254:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1782756332.686743:0:14254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1782756332.687171:0:14254:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1782756332.687176:0:14254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1782756332.687644:0:14254:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782756332.687758:0:14254:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1782756332.687763:0:14254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1782756332.688253:0:14254:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1782756332.688259:0:14254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1782756332.703844:0:14254:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782756332.704055:0:14254:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1782756332.704062:0:14254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1782756332.705315:0:14254:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1782756332.705329:0:14254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1782756332.706344:0:14254:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1782756332.707673:0:14254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1782756332.708638:0:14254:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1782756332.708661:0:14254:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1782756332.708668:0:14254:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.125@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1782756332.708808:0:14254:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.125@tcp ctxt 0 is initialized 00000020:01000004:0.0:1782756332.708843:0:14254:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.125@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1782756332.708848:0:14254:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1782756332.708850:0:14254:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782756332.708851:0:14254:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782756332.708852:0:14254:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782756332.708854:0:14254:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782756332.708855:0:14254:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782756332.708856:0:14254:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782756332.708858:0:14254:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782756332.708860:0:14254:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782756332.708861:0:14254:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782756332.708863:0:14254:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1782756332.708866:0:14254:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782756332.708867:0:14254:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782756332.708872:0:14254:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782756332.708873:0:14254:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782756332.708874:0:14254:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782756332.708875:0:14254:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782756332.708876:0:14254:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782756332.708877:0:14254:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782756332.708878:0:14254:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782756332.708879:0:14254:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782756332.708905:0:14254:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1782756332.708938:0:14254:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222643328:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1782756332.709007:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756332.709126:0:14254:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c490fe3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782756332.709212:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222643328 00000100:00100000:1.0:1782756332.709220:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222643328 00000100:00100000:1.0:1782756332.709258:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782756332.709267:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fbb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+5:14254:x1869355222643328:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1782756332.709308:0:14267:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1782756332.709311:0:14267:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1782756332.709314:0:14267:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1782756332.709821:0:14288:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1782756332.710253:0:14267:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1782756332.711850:0:14289:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1782756332.711857:0:14289:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1782756332.711860:0:14289:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1782756332.711895:0:14289:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1782756332.712368:0:14267:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1782756332.712378:0:14267:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1782756332.719278:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fbb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+5:14254:x1869355222643328:12345-0@lo:253:mount.lustre.0 Request processed in 10002us (10260us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756332.719294:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782756332.719377:0:14254:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222643328:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1782756332.719391:0:14254:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1782756332.719395:0:14254:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782756332.719396:0:14254:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782756332.719398:0:14254:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782756332.719399:0:14254:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782756332.719400:0:14254:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782756332.719401:0:14254:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782756332.719402:0:14254:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782756332.719404:0:14254:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782756332.719406:0:14254:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782756332.719407:0:14254:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1782756332.719426:0:14254:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d3c7fb26000 from lustre-MDT0000 10000000:01000000:0.0:1782756332.719450:0:14254:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1782756332.719452:0:14254:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1782756332.719456:0:14254:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9d3c50023380 10000000:01000000:0.0:1782756332.719460:0:14254:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782756332.719468:0:14254:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9d3c50023380 from 1 10000000:01000000:0.0:1782756332.719471:0:14254:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782756332.719509:0:14254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c76e17a00/0x5e4fb0a8aa199bff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756332.719521:0:14254:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c76e17a00/0x5e4fb0a8aa199bff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756332.719543:0:14254:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c76e17a00/0x5e4fb0a8aa199bff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756332.719563:0:14254:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222643456:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782756332.719598:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756332.719670:0:14254:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c490fe240 going to sleep for 11 seconds 00000100:00100000:3.0:1782756332.719763:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222643456 00000100:00100000:3.0:1782756332.719770:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222643456 00000100:00100000:3.0:1782756332.719844:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782756332.719853:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fbb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+5:14254:x1869355222643456:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782756332.719865:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756332.719880:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa199c06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa199bff expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756332.719902:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa199c06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199bff expref: 6 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756332.719912:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4168d200/0x5e4fb0a8aa199c06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199bff expref: 6 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756332.719938:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168d200, rc 0) 00000100:00100000:3.0:1782756332.719980:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fbb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+6:14254:x1869355222643456:12345-0@lo:101:mount.lustre.0 Request processed in 128us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756332.719986:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782756332.720045:0:14254:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222643456:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782756332.720058:0:14254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c76e17a00/0x5e4fb0a8aa199bff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199c06 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.720067:0:14254:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c76e17a00/0x5e4fb0a8aa199bff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa199c06 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756332.720136:0:14254:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222643584:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782756332.720168:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756332.720311:0:14254:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a4fa300 going to sleep for 11 seconds 00000100:00100000:0.0:1782756332.720340:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222643584 00000100:00100000:0.0:1782756332.720344:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222643584 00000100:00100000:0.0:1782756332.720365:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782756332.720371:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fbb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+6:14254:x1869355222643584:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782756332.720633:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fbb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+6:14254:x1869355222643584:12345-0@lo:501:mount.lustre.0 Request processed in 261us (463us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782756332.720709:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782756332.720774:0:14254:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222643584:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1782756332.720802:0:14254:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1782756332.720820:0:14254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c76e17a00/0x5e4fb0a8aa199bff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199c06 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.720828:0:14254:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c76e17a00/0x5e4fb0a8aa199bff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199c06 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782756332.720835:0:14254:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d3c7fb26000 10000000:01000000:2.0:1782756332.720840:0:14254:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1782756332.720843:0:14254:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9d3c7fb26000 10000000:01000000:2.0:1782756332.720845:0:14254:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1782756332.720848:0:14254:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9d3c7fb26000 from 1 10000000:01000000:2.0:1782756332.720850:0:14254:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1782756332.720870:0:14254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63c400/0x5e4fb0a8aa199c0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.720878:0:14254:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63c400/0x5e4fb0a8aa199c0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.720888:0:14254:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63c400/0x5e4fb0a8aa199c0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756332.720904:0:14254:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222643712:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782756332.720941:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756332.720964:0:14254:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a4fa300 going to sleep for 11 seconds 00000100:00100000:1.0:1782756332.721059:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222643712 00000100:00100000:1.0:1782756332.721063:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222643712 00000100:00100000:1.0:1782756332.721167:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782756332.721176:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fbb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+6:14254:x1869355222643712:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782756332.721185:0:14267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756332.721197:0:14267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c78ef5a00/0x5e4fb0a8aa199c14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa199c0d expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756332.721215:0:14267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c78ef5a00/0x5e4fb0a8aa199c14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199c0d expref: 7 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756332.721223:0:14267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c78ef5a00/0x5e4fb0a8aa199c14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199c0d expref: 7 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756332.721230:0:14267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef5a00, rc 0) 00000100:00100000:1.0:1782756332.721265:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fbb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+7:14254:x1869355222643712:12345-0@lo:101:mount.lustre.0 Request processed in 91us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756332.721271:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782756332.721340:0:14254:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222643712:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782756332.721362:0:14254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63c400/0x5e4fb0a8aa199c0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199c14 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.721370:0:14254:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63c400/0x5e4fb0a8aa199c0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa199c14 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782756332.721381:0:14254:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1782756332.721393:0:14254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63c400/0x5e4fb0a8aa199c0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199c14 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.721400:0:14254:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63c400/0x5e4fb0a8aa199c0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199c14 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782756332.721406:0:14254:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1782756332.721410:0:14254:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782756332.721415:0:14254:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9d3c7fb26000 10000000:01000000:2.0:1782756332.721417:0:14254:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1782756332.721420:0:14254:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1782756332.721423:0:14254:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1782756332.721437:0:14254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63da00/0x5e4fb0a8aa199c1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.721444:0:14254:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63da00/0x5e4fb0a8aa199c1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.721450:0:14254:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63da00/0x5e4fb0a8aa199c1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756332.721462:0:14254:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222643840:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782756332.721495:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756332.721632:0:14254:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a4fa300 going to sleep for 11 seconds 00000100:00100000:3.0:1782756332.721751:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222643840 00000100:00100000:3.0:1782756332.721757:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222643840 00000100:00100000:3.0:1782756332.721784:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782756332.721791:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fbb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+7:14254:x1869355222643840:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782756332.721798:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756332.721808:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4168c400/0x5e4fb0a8aa199c22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa199c1b expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756332.721823:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4168c400/0x5e4fb0a8aa199c22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199c1b expref: 8 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756332.721830:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4168c400/0x5e4fb0a8aa199c22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199c1b expref: 8 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756332.721836:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168c400, rc 0) 00000100:00100000:3.0:1782756332.721875:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fbb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+8:14254:x1869355222643840:12345-0@lo:101:mount.lustre.0 Request processed in 84us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756332.721881:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782756332.721955:0:14254:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222643840:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782756332.721966:0:14254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63da00/0x5e4fb0a8aa199c1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199c22 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.721974:0:14254:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63da00/0x5e4fb0a8aa199c1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa199c22 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756332.722013:0:14254:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222643968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782756332.722037:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756332.722059:0:14254:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a4fa300 going to sleep for 11 seconds 00000100:00100000:3.0:1782756332.722141:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222643968 00000100:00100000:3.0:1782756332.722145:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222643968 00000100:00100000:3.0:1782756332.722162:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782756332.722168:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fbb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+8:14254:x1869355222643968:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782756332.722503:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fbb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+9:14254:x1869355222643968:12345-0@lo:501:mount.lustre.0 Request processed in 333us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756332.722516:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782756332.722577:0:14254:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222643968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782756332.722604:0:14254:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222644096:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782756332.722652:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756332.722705:0:14254:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a4fa300 going to sleep for 11 seconds 00000100:00100000:0.0:1782756332.722815:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222644096 00000100:00100000:0.0:1782756332.722820:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222644096 00000100:00100000:3.0:1782756332.722861:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782756332.722869:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fbb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+9:14254:x1869355222644096:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782756332.723185:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fbb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+9:14254:x1869355222644096:12345-0@lo:503:mount.lustre.0 Request processed in 316us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756332.723192:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782756332.723337:0:14254:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222644096:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782756332.723806:0:14290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fbad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c7873c7-f262-4959-b911-d0a7cf42af86:14290:1869355222644224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782756332.723848:0:14290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756332.723876:0:14290:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a4fab40 going to sleep for 11 seconds 00000100:00100000:3.0:1782756332.724023:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222644224 00000100:00100000:3.0:1782756332.724028:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222644224 00000100:00100000:3.0:1782756332.724067:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782756332.724136:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fbb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+9:14290:x1869355222644224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782756332.724375:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fbb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+9:14290:x1869355222644224:12345-0@lo:502:llog_process_th.0 Request processed in 300us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756332.724381:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782756332.724477:0:14290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fbad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c7873c7-f262-4959-b911-d0a7cf42af86:14290:1869355222644224:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782756332.724502:0:14290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782756332.724513:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756332.724515:0:14290:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1782756332.724520:0:14290:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1782756332.724530:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782756332.724544:0:14290:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9d3c44d18000) 00000020:00000080:2.0:1782756332.724563:0:14290:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1782756332.724569:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1782756332.724631:0:14290:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:2.0:1782756332.724639:0:14290:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5e4fb0a8aa199c30 00000020:00000080:2.0:1782756332.724979:0:14290:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1782756332.724983:0:14290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782756332.724987:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756332.724988:0:14290:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1782756332.724991:0:14290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782756332.724995:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756332.724996:0:14290:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1782756332.724999:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782756332.725005:0:14290:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9d3c44d1cd40) 00000020:00000080:2.0:1782756332.725015:0:14290:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1782756332.725020:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1782756332.725021:0:14290:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1782756332.725024:0:14290:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1782756332.725030:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1782756332.725185:0:14290:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3c7fb26000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1782756332.725199:0:14290:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9d3c44d1b380) 00000020:00000080:2.0:1782756332.725209:0:14290:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1782756332.725252:0:14290:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1782756332.725258:0:14290:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5e4fb0a8aa199c45 00000020:00000080:2.0:1782756332.725347:0:14290:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1782756332.725353:0:14290:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1782756332.725357:0:14290:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5e4fb0a8aa199c4c 00080000:01000000:2.0:1782756332.725362:0:14290:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1782756332.725365:0:14290:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5e4fb0a8aa199c53 00010000:00010000:2.0:1782756332.787674:0:14290:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1782756332.788207:0:14290:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1782756332.788396:0:14290:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1782756332.789038:0:14290:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9d3c78fd0000) 00000020:00000080:2.0:1782756332.789057:0:14290:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1782756332.789141:0:14290:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1782756332.789149:0:14290:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5e4fb0a8aa199c61 00000020:00000080:3.0:1782756332.789582:0:14290:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1782756332.795047:0:14290:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5e4fb0a8aa199c68 00000020:00000080:3.0:1782756332.795867:0:14290:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1782756332.795880:0:14290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782756332.795887:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782756332.795889:0:14290:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1782756332.795893:0:14290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1782756332.795895:0:14290:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1782756332.795896:0:14290:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1782756332.795898:0:14290:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1782756332.795899:0:14290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1782756332.795996:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782756332.795998:0:14290:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1782756332.796003:0:14290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782756332.796008:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782756332.796009:0:14290:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1782756332.796021:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1782756332.796062:0:14290:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1782756332.796103:0:14290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782756332.796107:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782756332.796109:0:14290:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1782756332.796112:0:14290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782756332.796116:0:14290:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1782756332.796120:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782756332.796121:0:14290:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1782756332.796126:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1782756332.796132:0:14290:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.125@tcp to nid 0x20000c0a8cc7d (192.168.204.125@tcp) 00000020:01000000:3.0:1782756332.796161:0:14290:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1782756332.796165:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782756332.796180:0:14290:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9d3c500219c0) 00000020:00000080:3.0:1782756332.796199:0:14290:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1782756332.796205:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1782756332.796276:0:14290:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1782756332.796283:0:14290:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1782756332.796292:0:14290:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5e4fb0a8aa199c76 00010000:00080000:3.0:1782756332.796327:0:14290:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3c49f8d000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.125@tcp at head 00010000:00010000:3.0:1782756332.797432:0:14290:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1782756332.797843:0:14290:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1782756332.797889:0:14290:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1782756332.799139:0:14290:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782756332.799208:0:14290:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1782756332.799281:0:14290:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1782756332.799784:0:14294:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1782756332.799789:0:14294:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1782756332.801608:0:14290:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782756332.801624:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1782756332.801659:0:14290:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1782756332.801677:0:14290:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5e4fb0a8aa199c7d 00000100:00080000:0.0:1782756332.801687:0:14290:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782756332.801693:0:14290:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d3c49f8d000 using connection 192.168.204.125@tcp/0@lo 00000100:00100000:0.0:1782756332.801727:0:14290:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3b419fb480 x1869355222644352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782756332.801755:0:14290:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1782756332.801875:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869355222644352:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1782756332.801898:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c7873c7-f262-4959-b911-d0a7cf42af86:3317:1869355222644480:0@lo:400:kworker.0 00000400:00000100:1.0:1782756332.801951:0:3313:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869355222644352 offset 0 length 520: 4 00000020:01000000:1.0:1782756332.802173:0:14290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782756332.802179:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782756332.802181:0:14290:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1782756332.802187:0:14290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1782756332.802190:0:14290:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1782756332.802191:0:14290:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782756332.802193:0:14290:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782756332.802195:0:14290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1782756332.802199:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782756332.802200:0:14290:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1782756332.802202:0:14290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782756332.802207:0:14290:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1782756332.802210:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782756332.802212:0:14290:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1782756332.802216:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1782756332.802220:0:14290:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.125@tcp to nid 0x20000c0a8cc7d (192.168.204.125@tcp) 00000020:01000000:1.0:1782756332.802242:0:14290:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1782756332.802245:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782756332.802256:0:14290:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9d3c4aba3380) 00000020:00000080:1.0:1782756332.802269:0:14290:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1782756332.802275:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1782756332.802334:0:14290:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1782756332.802339:0:14290:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1782756332.802346:0:14290:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5e4fb0a8aa199c8b 00010000:00080000:1.0:1782756332.802372:0:14290:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3b41d9d000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.125@tcp at head 00000100:00100000:3.0:1782756332.802566:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756332.802619:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222644480 00000100:00100000:3.0:1782756332.802626:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222644480 00010000:00010000:1.0:1782756332.802670:0:14290:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1782756332.802671:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782756332.802683:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fbb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+9:3317:x1869355222644480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782756332.802735:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fbb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+9:3317:x1869355222644480:12345-0@lo:400:kworker.0 Request processed in 54us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756332.802743:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782756332.802790:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c7873c7-f262-4959-b911-d0a7cf42af86:3317:1869355222644480:0@lo:400:kworker.0 00000040:01000000:1.0:1782756332.803246:0:14290:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1782756332.803269:0:14290:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1782756332.804145:0:14290:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782756332.804217:0:14290:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1782756332.804286:0:14290:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1782756332.805747:0:14296:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1782756332.805765:0:14296:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1782756332.807056:0:14290:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782756332.807069:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1782756332.807260:0:14290:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1782756332.807281:0:14290:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5e4fb0a8aa199c92 00000100:00080000:1.0:1782756332.807293:0:14290:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782756332.807300:0:14290:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d3b41d9d000 using connection 192.168.204.125@tcp/0@lo 00000100:00100000:1.0:1782756332.807335:0:14290:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3c78e28a80 x1869355222644608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782756332.807362:0:14290:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1782756332.807468:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869355222644608:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1782756332.807525:0:3313:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869355222644608 offset 0 length 520: 4 00000020:01000000:1.0:1782756332.807699:0:14290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782756332.807704:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782756332.807706:0:14290:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1782756332.807709:0:14290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782756332.807712:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782756332.807714:0:14290:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782756332.807717:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782756332.807719:0:14290:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782756332.807721:0:14290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782756332.807722:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782756332.807724:0:14290:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1782756332.807726:0:14290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782756332.807729:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782756332.807730:0:14290:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1782756332.807734:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1782756332.807763:0:14290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e2b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c7873c7-f262-4959-b911-d0a7cf42af86:14290:1869355222644736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782756332.807819:0:14290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756332.807847:0:14290:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3b4116f000 going to sleep for 11 seconds 00000100:00100000:3.0:1782756332.808870:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222644736 00000100:00100000:3.0:1782756332.808879:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222644736 00000100:00100000:3.0:1782756332.808950:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782756332.808961:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c47ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+9:14290:x1869355222644736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782756332.809285:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c47ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+9:14290:x1869355222644736:12345-0@lo:502:llog_process_th.0 Request processed in 325us (1464us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756332.809294:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782756332.809350:0:14290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e2b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c7873c7-f262-4959-b911-d0a7cf42af86:14290:1869355222644736:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782756332.809390:0:14290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782756332.809397:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782756332.809399:0:14290:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1782756332.809404:0:14290:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1782756332.809641:0:14254:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1782756332.809659:0:14254:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1782756332.809733:0:14254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63da00/0x5e4fb0a8aa199c1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199c22 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.809746:0:14254:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63da00/0x5e4fb0a8aa199c1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199c22 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782756332.809755:0:14254:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9d3c7fb26000 from 1 10000000:01000000:2.0:1782756332.809757:0:14254:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782756332.809791:0:14254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63ce00/0x5e4fb0a8aa199c99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.809799:0:14254:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63ce00/0x5e4fb0a8aa199c99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.809808:0:14254:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63ce00/0x5e4fb0a8aa199c99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756332.809826:0:14254:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222644864:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782756332.809873:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756332.809916:0:14254:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a4fa540 going to sleep for 11 seconds 00000100:00100000:3.0:1782756332.810060:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222644864 00000100:00100000:3.0:1782756332.810066:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222644864 00000100:00100000:3.0:1782756332.810112:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782756332.810120:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c47ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+9:14254:x1869355222644864:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782756332.810130:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756332.810146:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4168dc00/0x5e4fb0a8aa199ca0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa199c99 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756332.810171:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4168dc00/0x5e4fb0a8aa199ca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199c99 expref: 10 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756332.810192:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4168dc00/0x5e4fb0a8aa199ca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199c99 expref: 10 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756332.810201:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168dc00, rc 0) 00000100:00100000:3.0:1782756332.810243:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c47ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+10:14254:x1869355222644864:12345-0@lo:101:mount.lustre.0 Request processed in 123us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756332.810252:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782756332.810327:0:14254:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222644864:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782756332.810340:0:14254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63ce00/0x5e4fb0a8aa199c99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199ca0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.810355:0:14254:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63ce00/0x5e4fb0a8aa199c99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa199ca0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756332.811214:0:14254:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222644992:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1782756332.811260:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756332.811311:0:14254:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a4fa540 going to sleep for 11 seconds 00000100:00100000:0.0:1782756332.811325:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222644992 00000100:00100000:0.0:1782756332.811333:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222644992 00000100:00100000:0.0:1782756332.811436:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782756332.811445:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c47eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+10:14254:x1869355222644992:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1782756332.811462:0:14265:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1782756332.811468:0:14265:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1782756332.811557:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c47eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+10:14254:x1869355222644992:12345-0@lo:256:mount.lustre.0 Request processed in 113us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756332.811565:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782756332.811651:0:14254:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222644992:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1782756332.813657:0:14254:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782756332.813706:0:14254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63ce00/0x5e4fb0a8aa199c99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199ca0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.813783:0:14254:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63ce00/0x5e4fb0a8aa199c99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199ca0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782756332.813793:0:14254:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9d3c7fb26000 from 1 10000000:01000000:2.0:1782756332.813796:0:14254:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782756332.813839:0:14254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63d400/0x5e4fb0a8aa199ca7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.813848:0:14254:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63d400/0x5e4fb0a8aa199ca7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.813858:0:14254:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63d400/0x5e4fb0a8aa199ca7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756332.813879:0:14254:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222645120:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782756332.813945:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756332.816513:0:14254:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a4fa540 going to sleep for 11 seconds 00000100:00100000:1.0:1782756332.816993:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222645120 00000100:00100000:1.0:1782756332.817003:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222645120 00000100:00100000:1.0:1782756332.817097:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782756332.817110:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c47ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+10:14254:x1869355222645120:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782756332.817128:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756332.817150:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199cae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa199ca7 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756332.817179:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199cae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199ca7 expref: 11 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756332.817192:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199cae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199ca7 expref: 11 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756332.817202:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef5c00, rc 0) 00000100:00100000:1.0:1782756332.817292:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c47ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+11:14254:x1869355222645120:12345-0@lo:101:mount.lustre.0 Request processed in 185us (3346us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756332.817299:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782756332.817355:0:14254:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222645120:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782756332.817376:0:14254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63d400/0x5e4fb0a8aa199ca7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199cae expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756332.817387:0:14254:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63d400/0x5e4fb0a8aa199ca7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa199cae expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756332.817468:0:14254:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e11880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222645248:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782756332.817502:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756332.817534:0:14254:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c43efa840 going to sleep for 11 seconds 00000100:00100000:1.0:1782756332.817685:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222645248 00000100:00100000:1.0:1782756332.817690:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222645248 00000100:00100000:1.0:1782756332.817724:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782756332.817731:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c47ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+11:14254:x1869355222645248:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782756332.818237:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c47ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+11:14254:x1869355222645248:12345-0@lo:501:mount.lustre.0 Request processed in 505us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756332.818254:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782756332.818659:0:14254:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e11880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222645248:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782756332.818700:0:14254:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222645376:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782756332.818745:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756332.818778:0:14254:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c490fe300 going to sleep for 11 seconds 00000100:00100000:3.0:1782756332.818835:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222645376 00000100:00100000:3.0:1782756332.818840:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222645376 00000100:00100000:3.0:1782756332.818884:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782756332.818892:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c47eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+11:14254:x1869355222645376:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782756332.819066:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c47eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+11:14254:x1869355222645376:12345-0@lo:503:mount.lustre.0 Request processed in 174us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756332.819092:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782756332.819294:0:14254:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222645376:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782756332.819733:0:14298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fbaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c7873c7-f262-4959-b911-d0a7cf42af86:14298:1869355222645504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782756332.819776:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756332.819807:0:14298:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a4fa900 going to sleep for 11 seconds 00000100:00100000:3.0:1782756332.819829:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222645504 00000100:00100000:3.0:1782756332.819835:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222645504 00000100:00100000:3.0:1782756332.819979:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782756332.819987:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76ac9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+11:14298:x1869355222645504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782756332.820213:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76ac9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+11:14298:x1869355222645504:12345-0@lo:502:llog_process_th.0 Request processed in 224us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756332.820220:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782756332.820226:0:14298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fbaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c7873c7-f262-4959-b911-d0a7cf42af86:14298:1869355222645504:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782756332.820255:0:14298:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782756332.820267:0:14298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756332.820269:0:14298:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1782756332.820343:0:14298:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d3c7fb26000 00000020:00000080:2.0:1782756332.820355:0:14298:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782756332.820365:0:14298:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782756332.820368:0:14298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756332.820369:0:14298:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1782756332.820372:0:14298:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782756332.820375:0:14298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756332.820376:0:14298:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1782756332.820380:0:14298:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d3c7fb26000 00000020:00000080:2.0:1782756332.820382:0:14298:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782756332.820435:0:14298:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782756332.820439:0:14298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756332.820440:0:14298:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1782756332.820443:0:14298:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782756332.820446:0:14298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756332.820447:0:14298:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782756332.820450:0:14298:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d3c7fb26000 00000020:00000080:2.0:1782756332.820453:0:14298:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782756332.820487:0:14298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fbaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c7873c7-f262-4959-b911-d0a7cf42af86:14298:1869355222645632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782756332.820522:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756332.823061:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222645632 00000100:00100000:2.0:1782756332.823225:0:14298:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a4fa900 going to sleep for 11 seconds 00000100:00100000:3.0:1782756332.823269:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222645632 00000100:00100000:3.0:1782756332.823313:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782756332.823321:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76ac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+11:14298:x1869355222645632:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782756332.825029:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76ac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+11:14298:x1869355222645632:12345-0@lo:502:llog_process_th.0 Request processed in 1701us (4499us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756332.825043:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782756332.825260:0:14298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fbaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c7873c7-f262-4959-b911-d0a7cf42af86:14298:1869355222645632:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782756332.825300:0:14298:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782756332.825308:0:14298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756332.825310:0:14298:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1782756332.825316:0:14298:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1782756332.828198:0:14254:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1782756332.828235:0:14254:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782756332.828298:0:14254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63d400/0x5e4fb0a8aa199ca7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199cae expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756332.828311:0:14254:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63d400/0x5e4fb0a8aa199ca7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199cae expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782756332.828366:0:14254:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1782756332.828369:0:14254:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d3c7fb26000 10000000:01000000:3.0:1782756332.828373:0:14254:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d3c7fb26000 10000000:01000000:3.0:1782756332.828377:0:14254:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782756332.828382:0:14254:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9d3c7fb26000 from 1 10000000:01000000:3.0:1782756332.828385:0:14254:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782756332.828425:0:14254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d000/0x5e4fb0a8aa199cb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756332.828446:0:14254:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d000/0x5e4fb0a8aa199cb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756332.828459:0:14254:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d000/0x5e4fb0a8aa199cb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756332.828484:0:14254:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e13b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222645760:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782756332.828553:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756332.828590:0:14254:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c43efa0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782756332.828658:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222645760 00000100:00100000:1.0:1782756332.828665:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222645760 00000100:00100000:1.0:1782756332.828754:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782756332.828765:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76ac8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+11:14254:x1869355222645760:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782756332.828779:0:14267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756332.828792:0:14267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c78ef4000/0x5e4fb0a8aa199cbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa199cb5 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756332.828816:0:14267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c78ef4000/0x5e4fb0a8aa199cbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199cb5 expref: 12 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756332.828828:0:14267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c78ef4000/0x5e4fb0a8aa199cbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199cb5 expref: 12 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756332.828837:0:14267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef4000, rc 0) 00000100:00100000:1.0:1782756332.828875:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76ac8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+12:14254:x1869355222645760:12345-0@lo:101:mount.lustre.0 Request processed in 114us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756332.828883:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782756332.828954:0:14254:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e13b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222645760:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782756332.828969:0:14254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d000/0x5e4fb0a8aa199cb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199cbc expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756332.828977:0:14254:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d000/0x5e4fb0a8aa199cb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa199cbc expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756332.829348:0:14254:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e13b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222645888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782756332.829380:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756332.829396:0:14254:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c43efa0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782756332.829416:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222645888 00000100:00100000:3.0:1782756332.829420:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222645888 00000100:00100000:3.0:1782756332.829445:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782756332.829451:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76ac9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+12:14254:x1869355222645888:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782756332.829743:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76ac9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+12:14254:x1869355222645888:12345-0@lo:501:mount.lustre.0 Request processed in 291us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756332.829751:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782756332.829811:0:14254:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e13b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222645888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782756332.829841:0:14254:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e13b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222646016:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782756332.829880:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756332.829894:0:14254:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c43efa0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782756332.829906:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222646016 00000100:00100000:3.0:1782756332.829909:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222646016 00000100:00100000:3.0:1782756332.829943:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782756332.829949:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76acac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+12:14254:x1869355222646016:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782756332.830297:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76acac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+12:14254:x1869355222646016:12345-0@lo:503:mount.lustre.0 Request processed in 346us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756332.830305:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782756332.830384:0:14254:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e13b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222646016:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782756332.830670:0:14302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e10a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c7873c7-f262-4959-b911-d0a7cf42af86:14302:1869355222646144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782756332.830709:0:14302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756332.830734:0:14302:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c43efa240 going to sleep for 11 seconds 00000100:00100000:1.0:1782756332.830794:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222646144 00000100:00100000:1.0:1782756332.830799:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222646144 00000100:00100000:1.0:1782756332.830864:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782756332.830872:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76aca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+12:14302:x1869355222646144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782756332.831158:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76aca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+12:14302:x1869355222646144:12345-0@lo:502:llog_process_th.0 Request processed in 285us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756332.831173:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782756332.831250:0:14302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e10a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c7873c7-f262-4959-b911-d0a7cf42af86:14302:1869355222646144:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1782756332.831304:0:14302:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1782756332.831318:0:14302:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9d3c50020000) 00000020:00000080:3.0:1782756332.831334:0:14302:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1782756332.833423:0:14302:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3c7fb26000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1782756332.833433:0:14302:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d3c7fb26000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1782756332.833436:0:14302:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9d3c7fb26000 4 00010000:00080000:3.0:1782756332.833473:0:14302:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3c44e2e000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.125@tcp at head 00010000:00010000:3.0:1782756332.836169:0:14302:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1782756332.836291:0:14302:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1782756332.836338:0:14302:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782756332.836354:0:14302:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5e4fb0a8aa199cca 00000100:00080000:3.0:1782756332.836365:0:14302:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782756332.836377:0:14302:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9d3c44e2e000 using connection 192.168.204.125@tcp/0@lo 00000100:00100000:3.0:1782756332.836411:0:14302:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3c78e10a80 x1869355222646272/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782756332.836452:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869355222646272:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1782756332.836531:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756332.836603:0:14272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222646272 00000100:00100000:3.0:1782756332.836610:0:14272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222646272 00000100:00100000:3.0:1782756332.836646:0:14272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782756332.836654:0:14272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1869355222646272:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1782756332.836708:0:14272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1869355222646272:12345-0@lo:38:llog_process_th.0 Request processed in 53us (176us total) trans 0 rc -11/-11 00000100:00100000:3.0:1782756332.836715:0:14272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782756332.836748:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782756332.836757:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9d3c44e2e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782756332.836777:0:3313:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1782756332.836782:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869355222646272:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1782756332.836820:0:14302:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1782756332.837262:0:14302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e10a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c7873c7-f262-4959-b911-d0a7cf42af86:14302:1869355222646400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782756332.837320:0:14302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756332.837446:0:14302:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c43efa240 going to sleep for 11 seconds 00000100:00100000:2.0:1782756332.837460:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222646400 00000100:00100000:2.0:1782756332.837467:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222646400 00000100:00100000:2.0:1782756332.837511:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782756332.837520:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76ac9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+12:14302:x1869355222646400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782756332.837788:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76ac9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+12:14302:x1869355222646400:12345-0@lo:502:llog_process_th.0 Request processed in 269us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756332.837796:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782756332.838179:0:14302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e10a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c7873c7-f262-4959-b911-d0a7cf42af86:14302:1869355222646400:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1782756332.838205:0:14302:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1782756332.838349:0:14254:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1782756332.838370:0:14254:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782756332.838393:0:14254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d000/0x5e4fb0a8aa199cb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199cbc expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.838404:0:14254:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c4168d000/0x5e4fb0a8aa199cb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199cbc expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782756332.838445:0:14254:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782756332.838447:0:14254:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782756332.838448:0:14254:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782756332.838449:0:14254:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782756332.838451:0:14254:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782756332.838452:0:14254:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782756332.838454:0:14254:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782756332.838455:0:14254:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782756332.838457:0:14254:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782756332.838458:0:14254:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782756332.838462:0:14254:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1782756332.838465:0:14254:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782756332.838471:0:14254:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782756332.838473:0:14254:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782756332.838474:0:14254:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782756332.838474:0:14254:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782756332.838476:0:14254:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782756332.838477:0:14254:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782756332.838477:0:14254:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782756332.838478:0:14254:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782756332.838479:0:14254:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782756332.838495:0:14254:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1782756332.838510:0:14254:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fbaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222646528:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782756332.838551:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756332.838570:0:14254:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a4fa900 going to sleep for 11 seconds 00000100:00100000:1.0:1782756332.838884:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222646528 00000100:00100000:1.0:1782756332.838891:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222646528 00000100:00100000:1.0:1782756332.838933:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782756332.838941:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76ac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+12:14254:x1869355222646528:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1782756332.838962:0:14267:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1782756332.838975:0:14267:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1782756332.884973:0:14267:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1782756332.884994:0:14267:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1782756332.885019:0:14288:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1782756332.885026:0:14288:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1782756332.885049:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d3c4168c000/0x5e4fb0a8aa199cd1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756332.885722:0:14288:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c4168dc00/0x5e4fb0a8aa199ca0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199c99 expref: 12 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756332.885731:0:14288:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d3c4168c000/0x5e4fb0a8aa199cd1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756332.885767:0:14288:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c4168dc00/0x5e4fb0a8aa199ca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa199c99 expref: 12 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756332.885781:0:14288:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3c4168dc00/0x5e4fb0a8aa199ca0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa199c99 expref: 12 pid: 14266 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756332.885796:0:14288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e10a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14288:1869355222646656:0@lo:104: 00000100:00100000:3.0:1782756332.885860:0:14288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756332.885913:0:14288:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c43efa9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782756332.886004:0:14255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222646656 00000100:00100000:1.0:1782756332.886013:0:14255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222646656 00000100:00100000:1.0:1782756332.886065:0:14255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782756332.886107:0:14255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c7873c7-f262-4959-b911-d0a7cf42af86+3:14288:x1869355222646656:12345-0@lo:104: 00010000:00010000:1.0:1782756332.886122:0:14255:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63ce00/0x5e4fb0a8aa199c99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa199ca0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756332.886185:0:14255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782756332.886192:0:14255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c7873c7-f262-4959-b911-d0a7cf42af86+3:14288:x1869355222646656:12345-0@lo:104: Request processed in 119us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756332.886200:0:14255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782756332.886228:0:14288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e10a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14288:1869355222646656:0@lo:104: 00010000:00010000:3.0:1782756332.886248:0:14288:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d3c4168c000/0x5e4fb0a8aa199cd1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.886622:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782756332.886629:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63ce00/0x5e4fb0a8aa199c99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa199ca0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.886637:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63ce00 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:2.0:1782756332.886640:0:14261:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63ce00/0x5e4fb0a8aa199c99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa199ca0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.886649:0:14261:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63ce00/0x5e4fb0a8aa199c99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa199ca0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782756332.886656:0:14261:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63ce00/0x5e4fb0a8aa199c99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa199ca0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782756332.886662:0:14261:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1782756332.886738:0:14261:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63ce00/0x5e4fb0a8aa199c99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa199ca0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.886745:0:14261:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782756332.886778:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63ce00/0x5e4fb0a8aa199c99 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa199ca0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.886793:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63ce00/0x5e4fb0a8aa199c99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa199ca0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.886810:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756332.886812:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756332.886814:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756332.886820:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c7873c7-f262-4959-b911-d0a7cf42af86:3314:1869355222646784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782756332.886857:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756332.886914:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222646784 00000100:00100000:2.0:1782756332.886929:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222646784 00010000:00010000:2.0:1782756332.886949:0:14257:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c4168dc00/0x5e4fb0a8aa199ca0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa199c99 expref: 13 pid: 14266 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756332.886973:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782756332.886980:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c7873c7-f262-4959-b911-d0a7cf42af86+13:3314:x1869355222646784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782756332.886991:0:14257:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756332.886997:0:14257:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c4168dc00/0x5e4fb0a8aa199ca0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa199c99 expref: 13 pid: 14266 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.887006:0:14257:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c4168dc00/0x5e4fb0a8aa199ca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa199c99 expref: 13 pid: 14266 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.887019:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4168dc00/0x5e4fb0a8aa199ca0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa199c99 expref: 13 pid: 14266 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.887034:0:14257:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d3c4168c000/0x5e4fb0a8aa199cd1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.887042:0:14257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4168c000/0x5e4fb0a8aa199cd1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782756332.887110:0:14257:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002084870s 00010000:00010000:2.0:1782756332.887116:0:14257:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3c4168c000/0x5e4fb0a8aa199cd1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.887124:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3c4168c000/0x5e4fb0a8aa199cd1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.887131:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d3c4168c000/0x5e4fb0a8aa199cd1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.887138:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d3c4168c000/0x5e4fb0a8aa199cd1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.887145:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168c000 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:2.0:1782756332.887149:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d3c4168c000/0x5e4fb0a8aa199cd1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.887156:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d3c4168c000/0x5e4fb0a8aa199cd1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.887176:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d3c4168c000/0x5e4fb0a8aa199cd1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756332.887186:0:14257:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782756332.887212:0:14288:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d3c4168c000/0x5e4fb0a8aa199cd1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756332.887222:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d3c4168c000/0x5e4fb0a8aa199cd1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756332.887227:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c7873c7-f262-4959-b911-d0a7cf42af86+12:3314:x1869355222646784:12345-0@lo:103:ldlm_bl.0 Request processed in 245us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756332.887238:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1782756332.887247:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4168c000/0x5e4fb0a8aa199cd1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756332.887275:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c7873c7-f262-4959-b911-d0a7cf42af86:3314:1869355222646784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782756332.899257:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76ac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+11:14254:x1869355222646528:12345-0@lo:253:mount.lustre.0 Request processed in 60307us (60695us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756332.899275:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782756332.899303:0:14254:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fbaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14254:1869355222646528:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782756332.899334:0:14254:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1782756332.899338:0:14254:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782756332.899340:0:14254:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782756332.899357:0:14254:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782756332.899359:0:14254:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782756332.899360:0:14254:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782756332.899362:0:14254:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782756332.899364:0:14254:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782756332.899365:0:14254:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782756332.899367:0:14254:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782756332.899368:0:14254:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782756332.899385:0:14254:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1782756332.905850:0:14254:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1782756332.906046:0:14254:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1782756332.906337:0:14254:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1782756332.907012:0:14254:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1782756332.907408:0:14254:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1782756332.907639:0:14254:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1782756332.916004:0:14254:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1782756332.916369:0:14254:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1782756332.916703:0:14254:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1782756332.916947:0:14254:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1782756332.917309:0:14254:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1782756332.917550:0:14254:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1782756332.947690:0:14254:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1782756332.948157:0:14254:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1782756332.948172:0:14311:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1782756332.948177:0:14311:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1782756332.948314:0:14312:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1782756332.948386:0:14312:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1782756332.951387:0:14254:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1782756332.951662:0:14254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1782756332.952246:0:14254:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1782756332.952256:0:14254:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1782756332.952539:0:14254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782756332.953990:0:14312:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1782756332.954070:0:14312:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1782756332.954149:0:14312:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:1.0:1782756332.954646:0:14254:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1782756332.955233:0:14254:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1782756332.955266:0:14254:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1782756332.956197:0:14254:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:1.0:1782756332.957140:0:14254:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1782756332.962168:0:14254:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1782756332.997277:0:14254:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1782756332.997321:0:14254:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa98c0152b988 00100000:10000000:1.0:1782756332.997330:0:14254:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1782756332.998368:0:14254:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1782756332.998383:0:14254:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.125@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1782756332.998405:0:14254:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1782756332.998429:0:14254:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1782756333.645416:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782756333.900376:0:14307:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782756333.900693:0:14307:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782756333.901407:0:14307:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1782756333.901416:0:14307:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:3.0:1782756334.092156:0:14269:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1782756334.092166:0:14269:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9d3c7fb26000 from 6 10000000:01000000:3.0:1782756334.092172:0:14269:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782756334.092221:0:14269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4168ca00/0x5e4fb0a8aa199cd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756334.092233:0:14269:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c4168ca00/0x5e4fb0a8aa199cd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756334.092268:0:14269:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c4168ca00/0x5e4fb0a8aa199cd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756334.092295:0:14269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e10a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222646912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782756334.092370:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756334.092943:0:14269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c464ed480 going to sleep for 11 seconds 00000100:00100000:2.0:1782756334.093479:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222646912 00000100:00100000:2.0:1782756334.093487:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222646912 00000100:00100000:2.0:1782756334.093535:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782756334.093542:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76aca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+11:14269:x1869355222646912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782756334.093554:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756334.093568:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4a63c200/0x5e4fb0a8aa199cdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa199cd8 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756334.093597:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4a63c200/0x5e4fb0a8aa199cdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199cd8 expref: 12 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756334.093605:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4a63c200/0x5e4fb0a8aa199cdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199cd8 expref: 12 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756334.093612:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63c200, rc 0) 00000100:00100000:2.0:1782756334.093671:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76aca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+12:14269:x1869355222646912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756334.093678:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782756334.093748:0:14269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e10a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222646912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782756334.093764:0:14269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c4168ca00/0x5e4fb0a8aa199cd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199cdf expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756334.093773:0:14269:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c4168ca00/0x5e4fb0a8aa199cd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa199cdf expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756334.093830:0:14269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222647040:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1782756334.093867:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756334.093913:0:14269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3b42980d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782756334.093959:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222647040 00000100:00100000:0.0:1782756334.093965:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222647040 00000100:00100000:0.0:1782756334.094001:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782756334.094009:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76aca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+12:14269:x1869355222647040:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1782756334.094024:0:14267:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782756334.094040:0:14267:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782756334.094043:0:14267:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1782756334.094271:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76aca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+12:14269:x1869355222647040:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 262us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756334.094280:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782756334.094347:0:14269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222647040:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1782756334.094392:0:14269:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782756334.094401:0:14269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4168ca00/0x5e4fb0a8aa199cd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199cdf expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756334.094537:0:14269:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c4168ca00/0x5e4fb0a8aa199cd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199cdf expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756334.673826:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782756334.924300:0:14307:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782756334.924309:0:14307:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782756334.924346:0:14307:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1782756334.924352:0:14307:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1782756335.696221:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782756335.761322:0:14557:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1782756336.716466:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756337.741176:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782756337.792479:0:14708:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef4c99e70 20000000:00000080:1.0:1782756337.792499:0:14708:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d3c75d1f400 uarg=0000000000000000 20000000:01000000:1.0:1782756337.792532:0:14708:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1782756337.792539:0:14708:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1782756337.792544:0:14708:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1782756337.793525:0:14709:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1782756337.793691:0:14708:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1782756337.803780:0:14708:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1782756337.803814:0:14708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa199ce6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756337.803847:0:14708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199cae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199ca7 expref: 11 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756337.803855:0:14708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa199ce6 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756337.803900:0:14708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199cae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa199ca7 expref: 11 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756337.803934:0:14708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199cae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa199ca7 expref: 11 pid: 14266 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756337.803949:0:14708:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e13800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14708:1869355222647168:0@lo:104: 00000100:00100000:3.0:1782756337.804216:0:14708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756337.804303:0:14708:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c464a80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782756337.804362:0:14255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222647168 00000100:00100000:1.0:1782756337.804370:0:14255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222647168 00000100:00100000:1.0:1782756337.804422:0:14255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782756337.804431:0:14255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c7873c7-f262-4959-b911-d0a7cf42af86+3:14708:x1869355222647168:12345-0@lo:104: 00010000:00010000:1.0:1782756337.804446:0:14255:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63d400/0x5e4fb0a8aa199ca7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa199cae expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756337.804525:0:14255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782756337.804532:0:14255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c7873c7-f262-4959-b911-d0a7cf42af86+3:14708:x1869355222647168:12345-0@lo:104: Request processed in 102us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756337.804539:0:14255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1782756337.804593:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782756337.804606:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63d400/0x5e4fb0a8aa199ca7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa199cae expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756337.804613:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d400 already unused, calling callback (ffffffffc1c85c20) 00000100:00100000:3.0:1782756337.804614:0:14708:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e13800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14708:1869355222647168:0@lo:104: 10000000:00010000:0.0:1782756337.804617:0:14261:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63d400/0x5e4fb0a8aa199ca7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa199cae expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756337.804624:0:14261:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63d400/0x5e4fb0a8aa199ca7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa199cae expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756337.804631:0:14708:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa199ce6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782756337.804632:0:14261:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63d400/0x5e4fb0a8aa199ca7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa199cae expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782756337.804638:0:14261:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782756337.804670:0:14261:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63d400/0x5e4fb0a8aa199ca7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa199cae expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756337.804677:0:14261:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782756337.804708:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63d400/0x5e4fb0a8aa199ca7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa199cae expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756337.804715:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63d400/0x5e4fb0a8aa199ca7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa199cae expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756337.804731:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756337.804733:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756337.804735:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756337.804750:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c7873c7-f262-4959-b911-d0a7cf42af86:3315:1869355222647296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782756337.804782:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756337.804852:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222647296 00000100:00100000:0.0:1782756337.804856:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222647296 00010000:00010000:0.0:1782756337.804875:0:14259:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199cae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa199ca7 expref: 12 pid: 14266 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756337.804914:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782756337.804921:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c7873c7-f262-4959-b911-d0a7cf42af86+12:3315:x1869355222647296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782756337.804932:0:14259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756337.804937:0:14259:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199cae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa199ca7 expref: 12 pid: 14266 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756337.804946:0:14259:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199cae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa199ca7 expref: 12 pid: 14266 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756337.804959:0:14259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c78ef5c00/0x5e4fb0a8aa199cae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa199ca7 expref: 12 pid: 14266 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756337.804972:0:14259:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa199ce6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756337.804979:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa199ce6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756337.804992:0:14259:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa199ce6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756337.804999:0:14259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa199ce6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756337.805005:0:14259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa199ce6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756337.805011:0:14259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa199ce6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756337.805028:0:14259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168d600 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:0.0:1782756337.805032:0:14259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa199ce6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756337.805039:0:14259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa199ce6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756337.805061:0:14259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa199ce6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756337.805072:0:14259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756337.805124:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c7873c7-f262-4959-b911-d0a7cf42af86+11:3315:x1869355222647296:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756337.805131:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782756337.805153:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c7873c7-f262-4959-b911-d0a7cf42af86:3315:1869355222647296:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782756337.805564:0:14708:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa199ce6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756337.805573:0:14708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa199ce6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756337.805681:0:14708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa199ce6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782756338.124505:0:13876:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782756338.124515:0:13876:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782756338.124518:0:13876:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782756338.124521:0:13876:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782756338.124524:0:13876:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1782756338.124527:0:13876:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1782756338.124531:0:13876:0:(import.c:65:import_set_state_nolock()) ffff9d3c44e2e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782756338.124544:0:13876:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9d3c44e2e000 using connection 192.168.204.125@tcp/0@lo 00000100:00100000:0.0:1782756338.124587:0:13876:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3b419f9180 x1869355222647424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782756338.125393:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869355222647424:0@lo:38:kworker.0 00000100:00100000:2.0:1782756338.125478:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756338.126541:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222647424 00000100:00100000:0.0:1782756338.126565:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222647424 00000100:00100000:0.0:1782756338.126651:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782756338.126660:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1869355222647424:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1782756338.126706:0:14274:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 379 last 0 00000020:00000080:0.0:1782756338.126741:0:14274:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5e4fb0a8aa199ced 00000004:00100000:0.0:1782756338.126757:0:14274:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1782756338.126913:0:14274:0:(import.c:65:import_set_state_nolock()) ffff9d3c4abba000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782756338.126997:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869355222647424:12345-0@lo:38:kworker.0 Request processed in 336us (1520us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756338.127005:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782756338.127098:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d3b419f9180 x1869355222647424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782756348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782756338.127116:0:3313:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1782756338.127124:0:3313:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1782756338.127129:0:3313:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1782756338.127133:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9d3c44e2e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1782756338.127140:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869355222647424:0@lo:38:kworker.0 00010000:00010000:0.0:1782756338.765485:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782756339.471209:0:14269:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782756339.471218:0:14269:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9d3c7fb26000 from 10 10000000:01000000:3.0:1782756339.471223:0:14269:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782756339.471269:0:14269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4168c200/0x5e4fb0a8aa199cf4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756339.471280:0:14269:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c4168c200/0x5e4fb0a8aa199cf4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756339.471292:0:14269:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c4168c200/0x5e4fb0a8aa199cf4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756339.471328:0:14269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222647552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782756339.471451:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756339.471495:0:14269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a052780 going to sleep for 11 seconds 00000100:00100000:3.0:1782756339.471527:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222647552 00000100:00100000:3.0:1782756339.471533:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222647552 00000100:00100000:3.0:1782756339.471683:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782756339.471691:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76acb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+11:14269:x1869355222647552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782756339.471706:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756339.471720:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa199cfb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa199cf4 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756339.471745:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa199cfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199cf4 expref: 12 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756339.471755:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa199cfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199cf4 expref: 12 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756339.471765:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168d600, rc 0) 00000100:00100000:3.0:1782756339.471860:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76acb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+12:14269:x1869355222647552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756339.471868:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782756339.471923:0:14269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222647552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782756339.471937:0:14269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c4168c200/0x5e4fb0a8aa199cf4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199cfb expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756339.471945:0:14269:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c4168c200/0x5e4fb0a8aa199cf4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa199cfb expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756339.472003:0:14269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222647680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782756339.472029:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756339.472052:0:14269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a052780 going to sleep for 11 seconds 00000100:00100000:0.0:1782756339.473381:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222647680 00000100:00100000:0.0:1782756339.473391:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222647680 00000100:00100000:0.0:1782756339.473545:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782756339.473556:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76acb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+12:14269:x1869355222647680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782756339.473841:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76acb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+12:14269:x1869355222647680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 287us (1810us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756339.473848:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782756339.477180:0:14269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222647680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782756339.477249:0:14269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e2b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222647808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782756339.477324:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756339.477362:0:14269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78a50300 going to sleep for 11 seconds 00000100:00100000:1.0:1782756339.477380:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222647808 00000100:00100000:1.0:1782756339.477386:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222647808 00000100:00100000:1.0:1782756339.477424:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782756339.477433:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76ac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+12:14269:x1869355222647808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782756339.477608:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76ac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+12:14269:x1869355222647808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756339.477622:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782756339.477665:0:14269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e2b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222647808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782756339.478281:0:14820:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1782756339.478330:0:14269:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1782756339.478348:0:14269:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782756339.478358:0:14269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4168c200/0x5e4fb0a8aa199cf4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199cfb expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756339.478369:0:14269:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c4168c200/0x5e4fb0a8aa199cf4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199cfb expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756339.788556:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1782756340.623894:0:14909:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782756340.623897:0:14909:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1782756340.624013:0:14909:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9d3b41148000 00000020:01000004:2.0:1782756340.624028:0:14909:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1782756340.624039:0:14909:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1782756340.624052:0:14909:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9d3c78fd19c0) 00000020:00000080:2.0:1782756340.624067:0:14909:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1782756340.641984:0:14909:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1782756340.642363:0:14909:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1782756340.643481:0:14909:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1782756340.643871:0:14909:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1782756340.644119:0:14909:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1782756340.644519:0:14909:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 433: rc = 0 00100000:10000000:3.0:1782756340.644605:0:14909:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 433: rc = 0 00100000:10000000:3.0:1782756340.644819:0:14909:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 433: rc = 0 00100000:10000000:3.0:1782756340.645507:0:14909:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 641: rc = 0 00100000:10000000:3.0:1782756340.645928:0:14909:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 641: rc = 0 00100000:10000000:3.0:1782756340.646224:0:14909:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 641: rc = 0 00100000:10000000:3.0:1782756340.646556:0:14909:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 641: rc = 0 00100000:10000000:3.0:1782756340.646957:0:14909:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 641: rc = 0 00100000:10000000:3.0:1782756340.647383:0:14909:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 641: rc = 0 00000020:00000080:3.0:1782756340.650874:0:14909:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1782756340.650890:0:14909:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782756340.650905:0:14909:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5e4fb0a8aa199d09 00000020:01000004:3.0:1782756340.650915:0:14909:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1782756340.650939:0:14909:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.125@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1782756340.650943:0:14909:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1782756340.650949:0:14909:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1782756340.650953:0:14909:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1782756340.650973:0:14909:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9d3c50024d40) 00000020:00000080:3.0:1782756340.650985:0:14909:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1782756340.652345:0:14909:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782756340.652498:0:14909:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1782756340.652505:0:14909:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1782756340.653482:0:14909:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1782756340.653491:0:14909:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1782756340.653937:0:14909:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1782756340.653944:0:14909:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1782756340.658899:0:14909:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782756340.660117:0:14909:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1782756340.660125:0:14909:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1782756340.662711:0:14909:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1782756340.662722:0:14909:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1782756340.676602:0:14909:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782756340.676880:0:14909:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1782756340.676887:0:14909:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1782756340.678313:0:14909:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1782756340.678325:0:14909:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1782756340.679215:0:14909:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1782756340.679224:0:14909:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1782756340.681574:0:14909:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782756340.681782:0:14909:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1782756340.681790:0:14909:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1782756340.682499:0:14909:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1782756340.682506:0:14909:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1782756340.709592:0:14909:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782756340.709826:0:14909:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1782756340.709835:0:14909:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1782756340.711063:0:14909:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1782756340.711246:0:14909:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1782756340.711621:0:14909:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1782756340.711648:0:14909:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1782756340.711657:0:14909:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.125@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1782756340.720062:0:14909:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.125@tcp ctxt 0 is initialized 00000020:01000004:0.0:1782756340.720174:0:14909:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.125@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1782756340.720180:0:14909:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1782756340.720182:0:14909:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782756340.720183:0:14909:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782756340.720184:0:14909:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782756340.720185:0:14909:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782756340.720191:0:14909:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782756340.720192:0:14909:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782756340.720193:0:14909:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782756340.720194:0:14909:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782756340.720198:0:14909:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1782756340.720200:0:14909:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782756340.720201:0:14909:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782756340.720202:0:14909:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782756340.720203:0:14909:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782756340.720204:0:14909:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782756340.720205:0:14909:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782756340.720206:0:14909:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782756340.720206:0:14909:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782756340.720207:0:14909:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782756340.720237:0:14909:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1782756340.720258:0:14909:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222647936:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1782756340.720340:0:14909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756340.720465:0:14909:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4562c240 going to sleep for 11 seconds 00000100:00100000:1.0:1782756340.720554:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222647936 00000100:00100000:1.0:1782756340.720562:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222647936 00000100:00100000:1.0:1782756340.720650:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782756340.720662:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76acbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+12:14909:x1869355222647936:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1782756340.720692:0:14265:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1782756340.720696:0:14265:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1782756340.720700:0:14265:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1782756340.730487:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76acbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+12:14909:x1869355222647936:12345-0@lo:253:mount.lustre.0 Request processed in 9817us (10136us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756340.730504:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782756340.730591:0:14909:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222647936:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1782756340.730606:0:14909:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1782756340.730610:0:14909:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782756340.730611:0:14909:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782756340.730613:0:14909:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782756340.730614:0:14909:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782756340.730615:0:14909:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782756340.730617:0:14909:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782756340.730618:0:14909:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782756340.730620:0:14909:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782756340.730683:0:14909:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1782756340.730713:0:14909:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d3b41148000 from lustre-OST0000 10000000:01000000:0.0:1782756340.730743:0:14909:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1782756340.730746:0:14909:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1782756340.730753:0:14909:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d3c50023380 local copy 00010000:00010000:0.0:1782756340.730775:0:14909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c76e17a00/0x5e4fb0a8aa199bff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199c06 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756340.731032:0:14909:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222648064:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782756340.731071:0:14909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756340.731223:0:14909:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c501156c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782756340.731269:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222648064 00000100:00100000:2.0:1782756340.731282:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222648064 00000100:00100000:2.0:1782756340.731365:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782756340.731375:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+12:14909:x1869355222648064:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782756340.731543:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+12:14909:x1869355222648064:12345-0@lo:501:mount.lustre.0 Request processed in 170us (472us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782756340.731551:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782756340.731638:0:14909:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222648064:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1782756340.731654:0:14909:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1782756340.731818:0:14909:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1782756340.731826:0:14909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c76e17a00/0x5e4fb0a8aa199bff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199c06 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756340.731836:0:14909:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c76e17a00/0x5e4fb0a8aa199bff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199c06 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782756340.731858:0:14909:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d3b41148000 10000000:01000000:0.0:1782756340.731863:0:14909:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1782756340.731868:0:14909:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9d3c50023380 10000000:01000000:0.0:1782756340.731871:0:14909:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1782756340.731875:0:14909:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9d3c50023380 from 1 10000000:01000000:0.0:1782756340.731878:0:14909:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782756340.731902:0:14909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c76e17600/0x5e4fb0a8aa199d17 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756340.731910:0:14909:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c76e17600/0x5e4fb0a8aa199d17 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756340.731919:0:14909:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c76e17600/0x5e4fb0a8aa199d17 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756340.731945:0:14909:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222648192:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782756340.731973:0:14909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756340.732191:0:14909:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c501156c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782756340.732281:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222648192 00000100:00100000:3.0:1782756340.732286:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222648192 00000100:00100000:3.0:1782756340.732311:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782756340.732317:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+12:14909:x1869355222648192:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782756340.732327:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756340.732341:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4168c000/0x5e4fb0a8aa199d1e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa199d17 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756340.732376:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4168c000/0x5e4fb0a8aa199d1e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199d17 expref: 13 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756340.732387:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4168c000/0x5e4fb0a8aa199d1e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199d17 expref: 13 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756340.732397:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168c000, rc 0) 00000100:00100000:3.0:1782756340.732438:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+13:14909:x1869355222648192:12345-0@lo:101:mount.lustre.0 Request processed in 120us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756340.732444:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782756340.732524:0:14909:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222648192:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782756340.732537:0:14909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c76e17600/0x5e4fb0a8aa199d17 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199d1e expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756340.732546:0:14909:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c76e17600/0x5e4fb0a8aa199d17 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa199d1e expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782756340.732563:0:14909:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782756340.732584:0:14909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c76e17600/0x5e4fb0a8aa199d17 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199d1e expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756340.732591:0:14909:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c76e17600/0x5e4fb0a8aa199d17 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199d1e expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782756340.732598:0:14909:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1782756340.732603:0:14909:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782756340.732607:0:14909:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1782756340.732609:0:14909:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1782756340.732686:0:14909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c76e16800/0x5e4fb0a8aa199d25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756340.732694:0:14909:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c76e16800/0x5e4fb0a8aa199d25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756340.732702:0:14909:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c76e16800/0x5e4fb0a8aa199d25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756340.732723:0:14909:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222648320:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782756340.732749:0:14909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756340.732772:0:14909:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c501156c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782756340.732834:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222648320 00000100:00100000:3.0:1782756340.732839:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222648320 00000100:00100000:3.0:1782756340.732857:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782756340.732864:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+13:14909:x1869355222648320:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782756340.732871:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756340.732879:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4168dc00/0x5e4fb0a8aa199d2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa199d25 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756340.732894:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4168dc00/0x5e4fb0a8aa199d2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199d25 expref: 14 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756340.732902:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4168dc00/0x5e4fb0a8aa199d2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199d25 expref: 14 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756340.732909:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4168dc00, rc 0) 00000100:00100000:3.0:1782756340.732948:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+14:14909:x1869355222648320:12345-0@lo:101:mount.lustre.0 Request processed in 84us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756340.732954:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782756340.733035:0:14909:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222648320:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782756340.733046:0:14909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c76e16800/0x5e4fb0a8aa199d25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199d2c expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756340.733054:0:14909:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c76e16800/0x5e4fb0a8aa199d25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa199d2c expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782756340.733756:0:14909:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1782756340.734616:0:14909:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782756340.735027:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1782756340.735121:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1782756340.735163:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1782756340.735214:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1782756340.735254:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1782756340.735292:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1782756340.735361:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1782756340.735371:0:14909:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1782756340.735446:0:14909:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222648448:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782756340.735504:0:14909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756340.735528:0:14909:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c50115540 going to sleep for 11 seconds 00000100:00100000:2.0:1782756340.735613:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222648448 00000100:00100000:2.0:1782756340.735619:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222648448 00000100:00100000:2.0:1782756340.735673:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782756340.735682:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78eb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+14:14909:x1869355222648448:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782756340.736020:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78eb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+14:14909:x1869355222648448:12345-0@lo:501:mount.lustre.0 Request processed in 339us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756340.736027:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782756340.736442:0:14909:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222648448:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782756340.736481:0:14909:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222648576:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782756340.736524:0:14909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756340.736554:0:14909:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c50115540 going to sleep for 11 seconds 00000100:00100000:3.0:1782756340.736695:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222648576 00000100:00100000:3.0:1782756340.736701:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222648576 00000100:00100000:3.0:1782756340.736725:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782756340.736733:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78eba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+14:14909:x1869355222648576:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782756340.737102:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78eba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+14:14909:x1869355222648576:12345-0@lo:503:mount.lustre.0 Request processed in 341us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756340.737109:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782756340.737258:0:14909:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222648576:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1782756340.738068:0:14909:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782756340.738170:0:14909:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222648704:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782756340.738214:0:14909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756340.738297:0:14909:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c50115540 going to sleep for 11 seconds 00000100:00100000:1.0:1782756340.738358:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222648704 00000100:00100000:1.0:1782756340.738364:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222648704 00000100:00100000:3.0:1782756340.738416:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782756340.738425:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ebac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+14:14909:x1869355222648704:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782756340.738715:0:14909:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222648704:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782756340.738973:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1782756340.739024:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1782756340.739062:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1782756340.739138:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1782756340.739178:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1782756340.739215:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1782756340.739268:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1782756340.739304:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1782756340.739338:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1782756340.739402:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1782756340.739438:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1782756340.739485:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1782756340.739517:0:14909:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222648832:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782756340.739790:0:14909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756340.739853:0:14909:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c50115540 going to sleep for 11 seconds 00000100:00100000:3.0:1782756340.739891:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ebac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+14:14909:x1869355222648704:12345-0@lo:502:mount.lustre.0 Request processed in 1466us (1676us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756340.739899:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782756340.739930:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222648832 00000100:00100000:3.0:1782756340.739935:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222648832 00000100:00100000:1.0:1782756340.739976:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782756340.740000:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7b937050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+14:14909:x1869355222648832:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782756340.740187:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7b937050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+14:14909:x1869355222648832:12345-0@lo:502:mount.lustre.0 Request processed in 203us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756340.740202:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782756340.740287:0:14909:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222648832:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782756340.740357:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1782756340.740367:0:14909:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1782756340.741268:0:14923:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1782756340.741278:0:14923:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1782756340.741285:0:14923:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782756340.741293:0:14923:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1782756340.741299:0:14923:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782756340.741313:0:14923:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9d3c76f04d40) 00000020:00000080:0.0:1782756340.741332:0:14923:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1782756340.741338:0:14923:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1782756340.741412:0:14923:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3b41148000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1782756340.741420:0:14923:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1782756340.741427:0:14923:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5e4fb0a8aa199d3a 00010000:00010000:0.0:1782756340.745253:0:14923:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1782756340.745750:0:14923:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1782756340.748017:0:14923:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1782756340.749368:0:14923:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1782756340.749380:0:14923:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782756340.749386:0:14923:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782756340.749388:0:14923:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1782756340.749391:0:14923:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1782756340.749394:0:14923:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1782756340.749395:0:14923:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1782756340.749397:0:14923:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1782756340.749399:0:14923:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1782756340.749401:0:14923:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782756340.749403:0:14923:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1782756340.749405:0:14923:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782756340.749408:0:14923:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782756340.749409:0:14923:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782756340.749412:0:14923:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782756340.749415:0:14923:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1782756340.749417:0:14923:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782756340.749419:0:14923:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782756340.749421:0:14923:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1782756340.749423:0:14923:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782756340.749425:0:14923:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782756340.749427:0:14923:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1782756340.749429:0:14923:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1782756340.749491:0:14923:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782756340.749494:0:14923:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782756340.749495:0:14923:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1782756340.749499:0:14923:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1782756340.749719:0:14909:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1782756340.749748:0:14909:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1782756340.749781:0:14909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c76e16800/0x5e4fb0a8aa199d25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199d2c expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756340.749793:0:14909:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c76e16800/0x5e4fb0a8aa199d25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199d2c expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756340.749802:0:14909:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9d3b41148000 from 1 10000000:01000000:1.0:1782756340.749804:0:14909:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782756340.749841:0:14909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef4400/0x5e4fb0a8aa199d41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756340.749850:0:14909:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef4400/0x5e4fb0a8aa199d41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756340.749862:0:14909:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef4400/0x5e4fb0a8aa199d41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756340.749884:0:14909:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e2b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222648960:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782756340.749946:0:14909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756340.749998:0:14909:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c5005a540 going to sleep for 11 seconds 00000100:00100000:0.0:1782756340.750129:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222648960 00000100:00100000:0.0:1782756340.750135:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222648960 00000100:00100000:0.0:1782756340.750179:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782756340.750188:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7b934050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+14:14909:x1869355222648960:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782756340.750201:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756340.750213:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c76e17200/0x5e4fb0a8aa199d48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa199d41 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756340.750235:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c76e17200/0x5e4fb0a8aa199d48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199d41 expref: 15 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756340.750246:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c76e17200/0x5e4fb0a8aa199d48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199d41 expref: 15 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756340.750255:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c76e17200, rc 0) 00000100:00100000:0.0:1782756340.750291:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7b934050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+15:14909:x1869355222648960:12345-0@lo:101:mount.lustre.0 Request processed in 103us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756340.750297:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782756340.750414:0:14909:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e2b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222648960:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782756340.750428:0:14909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef4400/0x5e4fb0a8aa199d41 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199d48 expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756340.750437:0:14909:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef4400/0x5e4fb0a8aa199d41 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa199d48 expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782756340.751052:0:14909:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1782756340.751504:0:14909:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782756340.751848:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1782756340.751888:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1782756340.751942:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1782756340.751949:0:14909:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1782756340.752008:0:14909:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e2b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222649088:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782756340.752062:0:14909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756340.752196:0:14909:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c5005a540 going to sleep for 11 seconds 00000100:00100000:3.0:1782756340.754372:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222649088 00000100:00100000:3.0:1782756340.754387:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222649088 00000100:00100000:3.0:1782756340.754465:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782756340.754475:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7b935050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+15:14909:x1869355222649088:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782756340.754915:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7b935050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+15:14909:x1869355222649088:12345-0@lo:501:mount.lustre.0 Request processed in 440us (2851us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756340.754922:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782756340.755020:0:14909:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e2b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222649088:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782756340.755071:0:14909:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e2b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222649216:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782756340.755154:0:14909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756340.755180:0:14909:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c5005a540 going to sleep for 11 seconds 00000100:00100000:3.0:1782756340.755281:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222649216 00000100:00100000:3.0:1782756340.755286:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222649216 00000100:00100000:3.0:1782756340.755317:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782756340.755324:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7b934850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+15:14909:x1869355222649216:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782756340.755476:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7b934850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+15:14909:x1869355222649216:12345-0@lo:503:mount.lustre.0 Request processed in 151us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756340.755492:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782756340.755600:0:14909:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e2b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222649216:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1782756340.756243:0:14909:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782756340.756317:0:14909:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fbb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222649344:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782756340.756358:0:14909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756340.756390:0:14909:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4b962c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782756340.756481:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222649344 00000100:00100000:3.0:1782756340.756486:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222649344 00000100:00100000:3.0:1782756340.756520:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782756340.756528:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7b937850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+15:14909:x1869355222649344:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782756340.756825:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7b937850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+15:14909:x1869355222649344:12345-0@lo:502:mount.lustre.0 Request processed in 296us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756340.756832:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782756340.756922:0:14909:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fbb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222649344:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782756340.758886:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1782756340.758980:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1782756340.759032:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1782756340.759070:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1782756340.759127:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1782756340.759174:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1782756340.759212:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1782756340.759244:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1782756340.759302:0:14909:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fbb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222649472:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782756340.759374:0:14909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756340.759778:0:14909:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4b962c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782756340.762524:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222649472 00000100:00100000:1.0:1782756340.762539:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222649472 00000100:00100000:1.0:1782756340.762604:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782756340.762615:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7b937450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+15:14909:x1869355222649472:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782756340.763041:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7b937450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+15:14909:x1869355222649472:12345-0@lo:502:mount.lustre.0 Request processed in 427us (3665us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756340.763050:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782756340.763284:0:14909:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fbb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222649472:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782756340.763442:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1782756340.763461:0:14909:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1782756340.769149:0:14927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782756340.769164:0:14927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756340.769166:0:14927:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1782756340.769174:0:14927:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d3b41148000 00000020:00000080:2.0:1782756340.769177:0:14927:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782756340.769185:0:14927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782756340.769188:0:14927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756340.769189:0:14927:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1782756340.769191:0:14927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782756340.769194:0:14927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756340.769195:0:14927:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1782756340.769198:0:14927:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d3b41148000 00000020:00000080:2.0:1782756340.769200:0:14927:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782756340.769290:0:14927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782756340.769294:0:14927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756340.769295:0:14927:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1782756340.769297:0:14927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782756340.769299:0:14927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756340.769300:0:14927:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782756340.769303:0:14927:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d3b41148000 00000020:00000080:2.0:1782756340.769305:0:14927:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782756340.772320:0:14927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782756340.772332:0:14927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756340.772334:0:14927:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1782756340.772340:0:14927:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1782756340.777880:0:14909:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1782756340.777927:0:14909:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782756340.777958:0:14909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef4400/0x5e4fb0a8aa199d41 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199d48 expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756340.777972:0:14909:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef4400/0x5e4fb0a8aa199d41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199d48 expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782756340.778018:0:14909:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1782756340.778021:0:14909:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d3b41148000 10000000:01000000:3.0:1782756340.778023:0:14909:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d3b41148000 10000000:01000000:3.0:1782756340.778027:0:14909:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782756340.778032:0:14909:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9d3b41148000 from 1 10000000:01000000:3.0:1782756340.778034:0:14909:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782756340.778069:0:14909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41497c00/0x5e4fb0a8aa199d4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756340.778107:0:14909:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c41497c00/0x5e4fb0a8aa199d4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756340.778119:0:14909:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c41497c00/0x5e4fb0a8aa199d4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756340.778144:0:14909:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e11c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222649600:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782756340.778209:0:14909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756340.778248:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222649600 00000100:00100000:3.0:1782756340.778254:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222649600 00000100:00100000:3.0:1782756340.778291:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782756340.778300:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7b937c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+15:14909:x1869355222649600:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782756340.778314:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756340.778326:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c41497800/0x5e4fb0a8aa199d56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa199d4f expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756340.778349:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c41497800/0x5e4fb0a8aa199d56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199d4f expref: 16 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756340.778359:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c41497800/0x5e4fb0a8aa199d56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199d4f expref: 16 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756340.778369:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41497800, rc 0) 00000100:00100000:3.0:1782756340.778398:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7b937c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+16:14909:x1869355222649600:12345-0@lo:101:mount.lustre.0 Request processed in 98us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756340.778404:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782756340.778446:0:14909:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a2cf900 going to sleep for 11 seconds 00000100:00100000:3.0:1782756340.778472:0:14909:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e11c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222649600:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782756340.778485:0:14909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c41497c00/0x5e4fb0a8aa199d4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199d56 expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756340.778494:0:14909:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c41497c00/0x5e4fb0a8aa199d4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa199d56 expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782756340.782307:0:14909:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1782756340.787607:0:14909:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782756340.788386:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1782756340.788435:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1782756340.788470:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1782756340.788512:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1782756340.788543:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1782756340.788592:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1782756340.789263:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1782756340.789396:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1782756340.789457:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1782756340.789494:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1782756340.789532:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1782756340.789589:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1782756340.790165:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1782756340.790243:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1782756340.790707:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1782756340.790789:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1782756340.790827:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1782756340.790882:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1782756340.790919:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1782756340.790960:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1782756340.791008:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1782756340.791041:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1782756340.791439:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1782756340.791506:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1782756340.791543:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1782756340.791574:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1782756340.791615:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1782756340.792186:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1782756340.792371:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1782756340.792381:0:14909:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1782756340.792491:0:14909:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e11c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222649728:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782756340.792565:0:14909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756340.792600:0:14909:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a2cf900 going to sleep for 11 seconds 00000100:00100000:1.0:1782756340.793062:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222649728 00000100:00100000:1.0:1782756340.793070:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222649728 00000100:00100000:1.0:1782756340.793136:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782756340.793146:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7b934450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+16:14909:x1869355222649728:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782756340.793418:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7b934450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+16:14909:x1869355222649728:12345-0@lo:501:mount.lustre.0 Request processed in 274us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756340.793433:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782756340.793555:0:14909:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e11c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222649728:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782756340.793595:0:14909:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e11c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222649856:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782756340.793652:0:14909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756340.793677:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222649856 00000100:00100000:3.0:1782756340.793681:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222649856 00000100:00100000:3.0:1782756340.793704:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782756340.793711:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7b936450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+16:14909:x1869355222649856:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782756340.793863:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7b936450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+16:14909:x1869355222649856:12345-0@lo:503:mount.lustre.0 Request processed in 152us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756340.793870:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782756340.793928:0:14909:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a2cf900 going to sleep for 11 seconds 00000100:00100000:3.0:1782756340.793941:0:14909:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e11c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222649856:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1782756340.794497:0:14909:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782756340.794574:0:14909:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e11c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222649984:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782756340.794617:0:14909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756340.794640:0:14909:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a2cf900 going to sleep for 11 seconds 00000100:00100000:1.0:1782756340.794928:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222649984 00000100:00100000:1.0:1782756340.794934:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222649984 00000100:00100000:1.0:1782756340.794972:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1782756340.794981:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7b936c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+16:14909:x1869355222649984:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782756340.795219:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7b936c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+16:14909:x1869355222649984:12345-0@lo:502:mount.lustre.0 Request processed in 238us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756340.795228:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782756340.795446:0:14909:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e11c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222649984:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782756340.795844:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1782756340.795901:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1782756340.795946:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1782756340.795997:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1782756340.796036:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1782756340.796125:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1782756340.796177:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1782756340.796225:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1782756340.796621:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1782756340.796737:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1782756340.796787:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1782756340.796838:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1782756340.796874:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1782756340.796910:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1782756340.796960:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1782756340.797011:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1782756340.797042:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1782756340.797387:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1782756340.797425:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1782756340.797451:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1782756340.797503:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1782756340.797535:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1782756340.797566:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1782756340.797617:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1782756340.797856:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1782756340.797890:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1782756340.797941:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1782756340.797978:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1782756340.798009:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1782756340.798054:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1782756340.798192:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1782756340.798247:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1782756340.798355:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1782756340.798406:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1782756340.798440:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1782756340.798486:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1782756340.798518:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1782756340.798553:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1782756340.798700:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1782756340.798749:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1782756340.798816:0:14909:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e11c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222650112:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782756340.798901:0:14909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756340.799003:0:14909:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a2cf900 going to sleep for 11 seconds 00000100:00100000:1.0:1782756340.799052:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222650112 00000100:00100000:1.0:1782756340.799059:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222650112 00000100:00100000:1.0:1782756340.801422:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1782756340.801438:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7b934c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+16:14909:x1869355222650112:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782756340.801941:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7b934c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+16:14909:x1869355222650112:12345-0@lo:502:mount.lustre.0 Request processed in 507us (3039us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756340.801949:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782756340.802036:0:14909:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e11c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222650112:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782756340.802733:0:14909:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1782756340.802754:0:14909:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1782756340.807914:0:14932:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1782756340.807950:0:14932:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9d3c7f2b19c0) 00000020:00000080:3.0:1782756340.807973:0:14932:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1782756340.808196:0:14932:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3b41148000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1782756340.808201:0:14932:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d3b41148000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1782756340.808204:0:14932:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9d3b41148000 3 00010000:00080000:3.0:1782756340.808240:0:14932:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3c7f2d1000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.125@tcp at head 00010000:00010000:3.0:1782756340.810981:0:14932:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1782756340.812394:0:14932:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1782756340.812442:0:14932:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782756340.812456:0:14932:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5e4fb0a8aa199d64 00000100:00080000:3.0:1782756340.812468:0:14932:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782756340.812474:0:14932:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d3c7f2d1000 using connection 192.168.204.125@tcp/0@lo 00000100:00100000:3.0:1782756340.812512:0:14932:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3c78e11c00 x1869355222650240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782756340.812551:0:14932:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1782756340.812667:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1869355222650240:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1782756340.812735:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756340.812889:0:14272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222650240 00000100:00100000:3.0:1782756340.812896:0:14272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222650240 00000100:00100000:3.0:1782756340.812931:0:14272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782756340.812938:0:14272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1869355222650240:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1782756340.812966:0:14272:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 382 last 0 00000020:00000080:3.0:1782756340.812997:0:14272:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5e4fb0a8aa199d6b 00000004:00100000:3.0:1782756340.813013:0:14272:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1782756340.813042:0:14272:0:(import.c:65:import_set_state_nolock()) ffff9d3c582a5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782756340.813124:0:14272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869355222650240:12345-0@lo:38:llog_process_th.0 Request processed in 183us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756340.813131:0:14272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1782756340.813244:0:13876:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782756340.813249:0:13876:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782756340.813252:0:13876:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782756340.813257:0:13876:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782756340.813453:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869355222650368:0@lo:400:kworker.0 00000100:00100000:2.0:1782756340.813490:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1782756340.813658:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d3c78e11c00 x1869355222650240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782756350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756340.813679:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782756340.813687:0:3313:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1782756340.813696:0:3313:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1782756340.813701:0:3313:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782756340.813704:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9d3c7f2d1000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782756340.813722:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1869355222650240:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1782756340.813737:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222650368 00000100:00100000:3.0:1782756340.813742:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222650368 00000100:00100000:3.0:1782756340.813792:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782756340.813800:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869355222650368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782756340.814838:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869355222650368:12345-0@lo:400:kworker.0 Request processed in 1033us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756340.814848:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:3.0:1782756340.816226:0:14932:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1782756340.816427:0:14909:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1782756340.816460:0:14909:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782756340.816484:0:14909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c41497c00/0x5e4fb0a8aa199d4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199d56 expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756340.816495:0:14909:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c41497c00/0x5e4fb0a8aa199d4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199d56 expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1782756340.816549:0:14909:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1782756340.816551:0:14909:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782756340.816552:0:14909:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782756340.816553:0:14909:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782756340.816554:0:14909:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782756340.816556:0:14909:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782756340.816557:0:14909:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782756340.816559:0:14909:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782756340.816560:0:14909:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782756340.816565:0:14909:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1782756340.816567:0:14909:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782756340.816568:0:14909:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782756340.816569:0:14909:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782756340.816570:0:14909:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782756340.816571:0:14909:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782756340.816572:0:14909:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782756340.816573:0:14909:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782756340.816574:0:14909:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782756340.816574:0:14909:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782756340.816598:0:14909:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1782756340.816619:0:14909:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222650496:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1782756340.816687:0:14909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756340.816721:0:14909:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c5005a480 going to sleep for 11 seconds 00000100:00100000:3.0:1782756340.816950:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222650496 00000100:00100000:3.0:1782756340.816958:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222650496 00000100:00100000:3.0:1782756340.816998:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782756340.817006:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c43e07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+16:14909:x1869355222650496:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1782756340.817030:0:14267:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1782756340.817043:0:14267:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1782756340.817733:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d3c78e28000 x1869355222650368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782756356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756340.817748:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869355222650368:0@lo:400:kworker.0 00010000:00010000:0.0:1782756340.817819:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:1.0:1782756340.847173:0:14267:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1782756340.847194:0:14267:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1782756340.847256:0:14288:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1782756340.847267:0:14288:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1782756340.847300:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d3c76e17800/0x5e4fb0a8aa199d72 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756340.847321:0:14288:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c4a63c200/0x5e4fb0a8aa199cdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199cd8 expref: 16 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756340.847330:0:14288:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d3c76e17800/0x5e4fb0a8aa199d72 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756340.847371:0:14288:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c4a63c200/0x5e4fb0a8aa199cdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa199cd8 expref: 16 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756340.847387:0:14288:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3c4a63c200/0x5e4fb0a8aa199cdf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa199cd8 expref: 16 pid: 14266 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756340.847403:0:14288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419fad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14288:1869355222650624:0@lo:104: 00000100:00100000:0.0:1782756340.847465:0:14288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756340.847509:0:14288:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c455829c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782756340.847675:0:14256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222650624 00000100:00100000:2.0:1782756340.847683:0:14256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222650624 00000100:00100000:2.0:1782756340.847736:0:14256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782756340.847747:0:14256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c7873c7-f262-4959-b911-d0a7cf42af86+3:14288:x1869355222650624:12345-0@lo:104: 00010000:00010000:2.0:1782756340.847772:0:14256:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: ffff9d3c4168ca00/0x5e4fb0a8aa199cd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa199cdf expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756340.847846:0:14256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782756340.847854:0:14256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c7873c7-f262-4959-b911-d0a7cf42af86+3:14288:x1869355222650624:12345-0@lo:104: Request processed in 109us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756340.847862:0:14256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782756340.847872:0:14288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419fad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14288:1869355222650624:0@lo:104: 00010000:00010000:0.0:1782756340.847895:0:14288:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d3c76e17800/0x5e4fb0a8aa199d72 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756340.847962:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782756340.847968:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c4168ca00/0x5e4fb0a8aa199cd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa199cdf expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756340.847976:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168ca00 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:1.0:1782756340.847990:0:14261:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4168ca00/0x5e4fb0a8aa199cd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa199cdf expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756340.848009:0:14261:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c4168ca00/0x5e4fb0a8aa199cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa199cdf expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782756340.848017:0:14261:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4168ca00/0x5e4fb0a8aa199cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa199cdf expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756340.848023:0:14261:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782756340.848053:0:14261:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c4168ca00/0x5e4fb0a8aa199cd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa199cdf expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756340.848059:0:14261:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782756340.848098:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c4168ca00/0x5e4fb0a8aa199cd8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa199cdf expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756340.848106:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c4168ca00/0x5e4fb0a8aa199cd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa199cdf expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756340.848122:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756340.848123:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756340.848125:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756340.848131:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782756340.848141:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c7873c7-f262-4959-b911-d0a7cf42af86:3316:1869355222650752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782756340.848169:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756340.848200:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222650752 00000100:00100000:1.0:1782756340.848204:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222650752 00010000:00010000:1.0:1782756340.848221:0:14257:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c4a63c200/0x5e4fb0a8aa199cdf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa199cd8 expref: 17 pid: 14266 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756340.848242:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782756340.848828:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c7873c7-f262-4959-b911-d0a7cf42af86+17:3316:x1869355222650752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782756340.848840:0:14257:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756340.848846:0:14257:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c4a63c200/0x5e4fb0a8aa199cdf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa199cd8 expref: 17 pid: 14266 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756340.848863:0:14257:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c4a63c200/0x5e4fb0a8aa199cdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa199cd8 expref: 17 pid: 14266 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756340.848878:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4a63c200/0x5e4fb0a8aa199cdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa199cd8 expref: 17 pid: 14266 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756340.848891:0:14257:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d3c76e17800/0x5e4fb0a8aa199d72 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756340.848899:0:14257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c76e17800/0x5e4fb0a8aa199d72 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782756340.848913:0:14257:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002084870s 00010000:00010000:1.0:1782756340.848918:0:14257:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3c76e17800/0x5e4fb0a8aa199d72 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756340.848926:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3c76e17800/0x5e4fb0a8aa199d72 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756340.848933:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d3c76e17800/0x5e4fb0a8aa199d72 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756340.848940:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d3c76e17800/0x5e4fb0a8aa199d72 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756340.848945:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c76e17800 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:1.0:1782756340.848955:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d3c76e17800/0x5e4fb0a8aa199d72 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756340.848963:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d3c76e17800/0x5e4fb0a8aa199d72 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756340.848977:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d3c76e17800/0x5e4fb0a8aa199d72 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756340.848987:0:14257:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782756340.849019:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c7873c7-f262-4959-b911-d0a7cf42af86+16:3316:x1869355222650752:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756340.849027:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1782756340.849057:0:14288:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d3c76e17800/0x5e4fb0a8aa199d72 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756340.849065:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d3c76e17800/0x5e4fb0a8aa199d72 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756340.849071:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c76e17800/0x5e4fb0a8aa199d72 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756340.849113:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c7873c7-f262-4959-b911-d0a7cf42af86:3316:1869355222650752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782756340.867636:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c43e07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+15:14909:x1869355222650496:12345-0@lo:253:mount.lustre.0 Request processed in 50621us (50939us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756340.867654:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782756340.867926:0:14909:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:14909:1869355222650496:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1782756340.867944:0:14909:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1782756340.867948:0:14909:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782756340.867950:0:14909:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782756340.867951:0:14909:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782756340.867952:0:14909:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782756340.867953:0:14909:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782756340.867954:0:14909:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782756340.867966:0:14909:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782756340.867968:0:14909:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782756340.867969:0:14909:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1782756340.867984:0:14909:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1782756340.875493:0:14909:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1782756340.875680:0:14909:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1782756340.876012:0:14909:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1782756340.876201:0:14909:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1782756340.876352:0:14909:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1782756340.876573:0:14909:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1782756340.881374:0:14909:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1782756340.938303:0:14909:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1782756340.938317:0:14909:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1782756340.938356:0:14909:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1782756340.938430:0:14909:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.125@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1782756340.938450:0:14909:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1782756340.938485:0:14909:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1782756341.836268:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782756342.033878:0:14269:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782756342.033891:0:14269:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9d3c7fb26000 from 7 10000000:01000000:2.0:1782756342.033898:0:14269:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782756342.033969:0:14269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63d800/0x5e4fb0a8aa199d79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756342.033985:0:14269:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63d800/0x5e4fb0a8aa199d79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756342.034101:0:14269:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63d800/0x5e4fb0a8aa199d79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756342.034139:0:14269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222650880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782756342.034242:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756342.034310:0:14269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a764cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782756342.034869:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222650880 00000100:00100000:1.0:1782756342.034882:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222650880 00000100:00100000:1.0:1782756342.038888:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782756342.038919:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c43e06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+15:14269:x1869355222650880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782756342.038948:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756342.038982:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c78ef4200/0x5e4fb0a8aa199d80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa199d79 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.039027:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c78ef4200/0x5e4fb0a8aa199d80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199d79 expref: 16 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.039042:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c78ef4200/0x5e4fb0a8aa199d80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199d79 expref: 16 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.039062:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c78ef4200, rc 0) 00000100:00100000:1.0:1782756342.039337:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c43e06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+16:14269:x1869355222650880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 430us (5093us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756342.039346:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782756342.039666:0:14269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222650880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782756342.039711:0:14269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63d800/0x5e4fb0a8aa199d79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199d80 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.039724:0:14269:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63d800/0x5e4fb0a8aa199d79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa199d80 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756342.039832:0:14269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222651008:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1782756342.039892:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756342.039986:0:14269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c542c8480 going to sleep for 11 seconds 00000100:00100000:3.0:1782756342.040331:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222651008 00000100:00100000:3.0:1782756342.040342:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222651008 00000100:00100000:3.0:1782756342.040503:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782756342.040515:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c795c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+16:14269:x1869355222651008:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1782756342.040637:0:14267:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1782756342.040662:0:14267:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1782756342.040666:0:14267:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1782756342.040799:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c795c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+16:14269:x1869355222651008:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 286us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756342.040808:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782756342.040885:0:14269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222651008:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1782756342.040962:0:14269:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782756342.040974:0:14269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63d800/0x5e4fb0a8aa199d79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199d80 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.040986:0:14269:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63d800/0x5e4fb0a8aa199d79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199d80 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.860170:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782756342.860196:0:3313:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782756332/real 1782756332] req@ffff9d3c78e28a80 x1869355222644608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782756342 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756342.860224:0:3313:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d3c78e28a80 x1869355222644608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782756342 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756342.860235:0:3313:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782756332/real 1782756332] req@ffff9d3b419fb480 x1869355222644352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782756342 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756342.860248:0:3313:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d3b419fb480 x1869355222644352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782756342 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782756342.860266:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9d3b41d9d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782756342.860292:0:3313:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1782756342.860297:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869355222644608:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1782756342.860305:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9d3c49f8d000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782756342.860311:0:3313:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1782756342.860313:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869355222644352:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1782756342.860460:0:13876:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782756342.860464:0:13876:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1782756342.860467:0:13876:0:(import.c:65:import_set_state_nolock()) ffff9d3c49f8d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782756342.860472:0:13876:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 374 00000100:00080000:1.0:1782756342.860477:0:13876:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1782756342.860484:0:13876:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d3c49f8d000 using connection 192.168.204.125@tcp/0@lo 00000100:00100000:1.0:1782756342.860505:0:13876:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3c78e28700 x1869355222651264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782756342.860530:0:13876:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782756342.860533:0:13876:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1782756342.860535:0:13876:0:(import.c:65:import_set_state_nolock()) ffff9d3b41d9d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782756342.860539:0:13876:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 374 00000100:00080000:1.0:1782756342.860542:0:13876:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1782756342.860546:0:13876:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d3b41d9d000 using connection 192.168.204.125@tcp/0@lo 00000100:00100000:1.0:1782756342.860559:0:13876:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3c78e2a680 x1869355222651392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782756342.860617:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869355222651648:0@lo:400:kworker.0 00000100:00100000:1.0:1782756342.860684:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756342.860781:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222651648 00000100:00100000:1.0:1782756342.860788:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222651648 00000100:00100000:1.0:1782756342.860848:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782756342.860859:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869355222651648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756342.860917:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869355222651648:12345-0@lo:400:kworker.0 Request processed in 59us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756342.860923:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1782756342.860954:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782756342.860979:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3c78e2ad80 x1869355222651648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782756358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756342.860990:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869355222651648:0@lo:400:kworker.0 00000100:00100000:0.0:1782756342.861176:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869355222651520:0@lo:400:kworker.0 00000100:00100000:0.0:1782756342.861208:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756342.861236:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782756342.861242:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c7873c7-f262-4959-b911-d0a7cf42af86:3315:1869355222651136:0@lo:400:kworker.0 00000100:00100000:0.0:1782756342.861269:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756342.861298:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222651136 00000100:00100000:0.0:1782756342.861303:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222651136 00000100:00100000:0.0:1782756342.861331:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782756342.861338:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c795c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+16:3315:x1869355222651136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756342.861372:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c795c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+16:3315:x1869355222651136:12345-0@lo:400:kworker.0 Request processed in 35us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756342.861378:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782756342.861421:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c7873c7-f262-4959-b911-d0a7cf42af86:3315:1869355222651136:0@lo:400:kworker.0 00000100:00100000:1.0:1782756342.861513:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222651520 00000100:00100000:1.0:1782756342.861517:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222651520 00000100:00100000:1.0:1782756342.861540:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782756342.861546:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869355222651520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756342.861654:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869355222651520:12345-0@lo:400:kworker.0 Request processed in 107us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756342.861660:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1782756342.861730:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3c78e28380 x1869355222651520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782756358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756342.861741:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869355222651520:0@lo:400:kworker.0 00000100:00100000:3.0:1782756342.861820:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869355222651264:0@lo:8:kworker.0 00000100:00100000:3.0:1782756342.861861:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756342.862129:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869355222651392:0@lo:8:kworker.0 00000100:00100000:3.0:1782756342.862153:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756342.864372:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222651264 00000100:00100000:0.0:1782756342.864382:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222651264 00000100:00100000:0.0:1782756342.864419:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222651392 00000100:00100000:0.0:1782756342.864422:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222651392 00000100:00100000:0.0:1782756342.864437:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782756342.864444:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1869355222651264:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1782756342.864473:0:14910:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 384 last 0 00000020:00000080:0.0:1782756342.864511:0:14910:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5e4fb0a8aa199d87 00002000:00100000:0.0:1782756342.864525:0:14910:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9d3c7794c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1782756342.864529:0:14910:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1782756342.864532:0:14910:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1782756342.864886:0:14910:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782756342.864911:0:14910:0:(import.c:65:import_set_state_nolock()) ffff9d3c7794f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782756342.864987:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1869355222651264:12345-0@lo:8:kworker.0 Request processed in 542us (3125us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756342.864994:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782756342.865009:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782756342.865014:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1869355222651392:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1782756342.865025:0:14910:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1782756342.865053:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1869355222651392:12345-0@lo:8:kworker.0 Request processed in 37us (2899us total) trans 0 rc -19/-19 00000100:00100000:0.0:1782756342.865060:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1782756342.865105:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3c78e28700 x1869355222651264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782756357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782756342.865121:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782756342.865131:0:3313:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1782756342.865138:0:3313:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1782756342.865143:0:3313:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1782756342.865146:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9d3c49f8d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1782756342.865417:0:14295:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:0.0:1782756342.865437:0:14295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419f9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14295:1869355222651904:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1782756342.865478:0:14295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756342.865498:0:14295:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c455829c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782756342.865516:0:14912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222651904 00000100:00100000:0.0:1782756342.865520:0:14912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222651904 00000100:00100000:0.0:1782756342.865556:0:14912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782756342.865563:0:14912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14295:x1869355222651904:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1782756342.865989:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1782756342.865999:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869355222651264:0@lo:8:kworker.0 00000100:00080000:2.0:1782756342.866025:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9d3b41d9d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782756342.866032:0:3313:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1782756342.866036:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869355222651392:0@lo:8:kworker.0 00000004:00080000:1.0:1782756342.867161:0:14294:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1782756342.867771:0:14294:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 384102694730ns, next at 0ns, rc = 0 00000100:00100000:1.0:1782756342.867944:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222651776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782756342.868014:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782756342.868069:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1782756342.869563:0:14912:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1782756342.869573:0:14912:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1782756342.869578:0:14912:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000100:00100000:2.0:1782756342.870161:0:14914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222651776 00000100:00100000:2.0:1782756342.870171:0:14914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222651776 00000100:00100000:2.0:1782756342.870277:0:14914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782756342.870286:0:14914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1869355222651776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782756342.870322:0:14914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782756342.870406:0:14914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1869355222651776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (2392us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756342.870422:0:14914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1782756342.870872:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3b419f8380 x1869355222651776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756342.870895:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222651776:0@lo:13:osp-pre-0-0.0 00002000:00010000:0.0:1782756342.883409:0:14912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782756342.883424:0:14912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e33eddf1/0x5e4fb0a8aa199d8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756342.883446:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1782756342.883451:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782756342.883458:0:14912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e33eddf1/0x5e4fb0a8aa199d8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756342.883478:0:14912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e33eddf1/0x5e4fb0a8aa199d8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756342.883490:0:14912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e33eddf1/0x5e4fb0a8aa199d8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756342.883500:0:14912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e33eddf1/0x5e4fb0a8aa199d8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756342.883519:0:14912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782756342.883533:0:14260:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782756342.883539:0:14260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e33eddf1/0x5e4fb0a8aa199d8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756342.883547:0:14260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c76e16000 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:0.0:1782756342.883553:0:14260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e33eddf1/0x5e4fb0a8aa199d8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756342.883576:0:14260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e33eddf1/0x5e4fb0a8aa199d8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756342.885682:0:14260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e33eddf1/0x5e4fb0a8aa199d8e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756342.885705:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e33eddf1/0x5e4fb0a8aa199d8e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756342.885742:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756342.885744:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756342.885747:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782756342.885921:0:14912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782756342.885930:0:14912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0e1c17f/0x5e4fb0a8aa199d95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.885944:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1782756342.885948:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756342.885954:0:14912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0e1c17f/0x5e4fb0a8aa199d95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.885970:0:14912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0e1c17f/0x5e4fb0a8aa199d95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.885981:0:14912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0e1c17f/0x5e4fb0a8aa199d95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.886063:0:14912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0e1c17f/0x5e4fb0a8aa199d95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.886113:0:14912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1782756342.886493:0:14912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782756342.886499:0:14912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa199d9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.886509:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1782756342.886519:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756342.886524:0:14912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa199d9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.886534:0:14912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa199d9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.886543:0:14912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa199d9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.886550:0:14912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa199d9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.886564:0:14912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782756342.887119:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782756342.887129:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0e1c17f/0x5e4fb0a8aa199d95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756342.887138:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41496400 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:0.0:1782756342.887143:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0e1c17f/0x5e4fb0a8aa199d95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756342.887152:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0e1c17f/0x5e4fb0a8aa199d95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756342.887179:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0e1c17f/0x5e4fb0a8aa199d95 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756342.887206:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0e1c17f/0x5e4fb0a8aa199d95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756342.887235:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782756342.887239:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa199d9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756342.887246:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41496600 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:0.0:1782756342.887249:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa199d9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756342.887257:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa199d9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756342.887269:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa199d9c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756342.887277:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa199d9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756342.887289:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756342.887291:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756342.887293:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756342.887316:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782756342.887913:0:14912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782756342.887920:0:14912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e13bf38/0x5e4fb0a8aa199da3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.887929:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1782756342.887931:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756342.887935:0:14912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e13bf38/0x5e4fb0a8aa199da3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.887943:0:14912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e13bf38/0x5e4fb0a8aa199da3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.887949:0:14912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e13bf38/0x5e4fb0a8aa199da3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.887963:0:14912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e13bf38/0x5e4fb0a8aa199da3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.887977:0:14912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782756342.888000:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782756342.888006:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e13bf38/0x5e4fb0a8aa199da3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756342.888014:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41497000 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:2.0:1782756342.888018:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e13bf38/0x5e4fb0a8aa199da3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756342.888026:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e13bf38/0x5e4fb0a8aa199da3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756342.888043:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e13bf38/0x5e4fb0a8aa199da3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756342.888050:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e13bf38/0x5e4fb0a8aa199da3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756342.888066:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756342.888068:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756342.888070:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782756342.888441:0:14912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782756342.888448:0:14912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8955f92/0x5e4fb0a8aa199daa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.888457:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1782756342.888461:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756342.888465:0:14912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8955f92/0x5e4fb0a8aa199daa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.888475:0:14912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8955f92/0x5e4fb0a8aa199daa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.888482:0:14912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8955f92/0x5e4fb0a8aa199daa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.888489:0:14912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8955f92/0x5e4fb0a8aa199daa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.888508:0:14912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782756342.888542:0:14260:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782756342.888551:0:14260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8955f92/0x5e4fb0a8aa199daa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.888561:0:14260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41497600 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:1.0:1782756342.888565:0:14260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8955f92/0x5e4fb0a8aa199daa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.888575:0:14260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8955f92/0x5e4fb0a8aa199daa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.888593:0:14260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8955f92/0x5e4fb0a8aa199daa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.888602:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8955f92/0x5e4fb0a8aa199daa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.888631:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756342.888634:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756342.888636:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782756342.889295:0:14912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782756342.889304:0:14912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d173de0e/0x5e4fb0a8aa199db1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.889322:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1782756342.889325:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756342.889330:0:14912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d173de0e/0x5e4fb0a8aa199db1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.889341:0:14912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d173de0e/0x5e4fb0a8aa199db1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.889351:0:14912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d173de0e/0x5e4fb0a8aa199db1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.889359:0:14912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d173de0e/0x5e4fb0a8aa199db1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.889379:0:14912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782756342.889472:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782756342.889479:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d173de0e/0x5e4fb0a8aa199db1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.889489:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41497400 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:1.0:1782756342.889494:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d173de0e/0x5e4fb0a8aa199db1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.889510:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d173de0e/0x5e4fb0a8aa199db1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.889529:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d173de0e/0x5e4fb0a8aa199db1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.889538:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d173de0e/0x5e4fb0a8aa199db1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.889564:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756342.889568:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756342.889571:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782756342.891453:0:14912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782756342.891470:0:14912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000306a8a32/0x5e4fb0a8aa199db8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.891488:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1782756342.891492:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756342.891499:0:14912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000306a8a32/0x5e4fb0a8aa199db8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.891515:0:14912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000306a8a32/0x5e4fb0a8aa199db8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.891539:0:14912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000306a8a32/0x5e4fb0a8aa199db8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.891547:0:14912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000306a8a32/0x5e4fb0a8aa199db8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.891566:0:14912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782756342.891579:0:14260:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756342.891807:0:14260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000306a8a32/0x5e4fb0a8aa199db8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.891815:0:14260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41497200 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756342.891821:0:14260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000306a8a32/0x5e4fb0a8aa199db8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.891831:0:14260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000306a8a32/0x5e4fb0a8aa199db8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.891851:0:14260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000306a8a32/0x5e4fb0a8aa199db8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.891859:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000306a8a32/0x5e4fb0a8aa199db8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.891881:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.891889:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.891891:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782756342.894517:0:14912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782756342.894532:0:14912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f5ace8b/0x5e4fb0a8aa199dbf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.894553:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1782756342.894558:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756342.894565:0:14912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f5ace8b/0x5e4fb0a8aa199dbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.894596:0:14912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f5ace8b/0x5e4fb0a8aa199dbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.894680:0:14912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f5ace8b/0x5e4fb0a8aa199dbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.894689:0:14912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f5ace8b/0x5e4fb0a8aa199dbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.894712:0:14912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782756342.894738:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756342.894745:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f5ace8b/0x5e4fb0a8aa199dbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.894754:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41496c00 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756342.894760:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f5ace8b/0x5e4fb0a8aa199dbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.894785:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f5ace8b/0x5e4fb0a8aa199dbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.894806:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f5ace8b/0x5e4fb0a8aa199dbf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.894814:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f5ace8b/0x5e4fb0a8aa199dbf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.894838:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.894840:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.894842:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782756342.895790:0:14912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782756342.895889:0:14912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec00210e/0x5e4fb0a8aa199dc6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.895902:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1782756342.895906:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756342.895911:0:14912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec00210e/0x5e4fb0a8aa199dc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.895922:0:14912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec00210e/0x5e4fb0a8aa199dc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.895930:0:14912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec00210e/0x5e4fb0a8aa199dc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.895945:0:14912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec00210e/0x5e4fb0a8aa199dc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.895964:0:14912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782756342.895976:0:14260:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756342.895981:0:14260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec00210e/0x5e4fb0a8aa199dc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.895987:0:14260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41496000 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756342.895991:0:14260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec00210e/0x5e4fb0a8aa199dc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.895999:0:14260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec00210e/0x5e4fb0a8aa199dc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.896013:0:14260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec00210e/0x5e4fb0a8aa199dc6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.896019:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec00210e/0x5e4fb0a8aa199dc6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.896034:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.896036:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.896037:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782756342.896507:0:14912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782756342.896523:0:14912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dced21c9/0x5e4fb0a8aa199dcd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.896533:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1782756342.896537:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756342.896541:0:14912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dced21c9/0x5e4fb0a8aa199dcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.896550:0:14912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dced21c9/0x5e4fb0a8aa199dcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.896558:0:14912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dced21c9/0x5e4fb0a8aa199dcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.896565:0:14912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dced21c9/0x5e4fb0a8aa199dcd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.896581:0:14912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782756342.897502:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756342.897513:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dced21c9/0x5e4fb0a8aa199dcd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.897524:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41497e00 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756342.897528:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dced21c9/0x5e4fb0a8aa199dcd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.897537:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dced21c9/0x5e4fb0a8aa199dcd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.897566:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dced21c9/0x5e4fb0a8aa199dcd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.897573:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dced21c9/0x5e4fb0a8aa199dcd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.897703:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.897705:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.897707:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782756342.900495:0:14912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782756342.900512:0:14912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042ea6f3d/0x5e4fb0a8aa199dd4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.900533:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1782756342.900538:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756342.900545:0:14912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042ea6f3d/0x5e4fb0a8aa199dd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.900560:0:14912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042ea6f3d/0x5e4fb0a8aa199dd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.900570:0:14912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042ea6f3d/0x5e4fb0a8aa199dd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.901919:0:14912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042ea6f3d/0x5e4fb0a8aa199dd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.901997:0:14912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782756342.902048:0:14260:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782756342.902060:0:14260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042ea6f3d/0x5e4fb0a8aa199dd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.902122:0:14260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41496800 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:1.0:1782756342.902127:0:14260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042ea6f3d/0x5e4fb0a8aa199dd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.902140:0:14260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042ea6f3d/0x5e4fb0a8aa199dd4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.902169:0:14260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042ea6f3d/0x5e4fb0a8aa199dd4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.902177:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042ea6f3d/0x5e4fb0a8aa199dd4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.902209:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756342.902213:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756342.902214:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782756342.902744:0:14912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782756342.902755:0:14912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000306a8a32/0x5e4fb0a8aa199ddb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.902769:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1782756342.902774:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756342.902780:0:14912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000306a8a32/0x5e4fb0a8aa199ddb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.902793:0:14912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000306a8a32/0x5e4fb0a8aa199ddb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.902802:0:14912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000306a8a32/0x5e4fb0a8aa199ddb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.902810:0:14912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000306a8a32/0x5e4fb0a8aa199ddb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.902836:0:14912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782756342.902954:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782756342.902962:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000306a8a32/0x5e4fb0a8aa199ddb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.902973:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41497200 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:1.0:1782756342.902978:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000306a8a32/0x5e4fb0a8aa199ddb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.902988:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000306a8a32/0x5e4fb0a8aa199ddb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.903014:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000306a8a32/0x5e4fb0a8aa199ddb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.903025:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000306a8a32/0x5e4fb0a8aa199ddb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.903048:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756342.903050:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756342.903053:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782756342.903302:0:14912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782756342.903309:0:14912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f5ace8b/0x5e4fb0a8aa199de2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.903317:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1782756342.903327:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756342.903331:0:14912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f5ace8b/0x5e4fb0a8aa199de2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.903341:0:14912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f5ace8b/0x5e4fb0a8aa199de2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.903349:0:14912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f5ace8b/0x5e4fb0a8aa199de2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.903357:0:14912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f5ace8b/0x5e4fb0a8aa199de2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.903381:0:14912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1782756342.904875:0:14912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782756342.904890:0:14912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d173de0e/0x5e4fb0a8aa199de9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.904905:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1782756342.904909:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756342.904915:0:14912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d173de0e/0x5e4fb0a8aa199de9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.904927:0:14912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d173de0e/0x5e4fb0a8aa199de9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.904936:0:14912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d173de0e/0x5e4fb0a8aa199de9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.904952:0:14912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d173de0e/0x5e4fb0a8aa199de9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.904971:0:14912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1782756342.904985:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782756342.904992:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f5ace8b/0x5e4fb0a8aa199de2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.905000:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41496c00 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756342.905005:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f5ace8b/0x5e4fb0a8aa199de2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.905015:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f5ace8b/0x5e4fb0a8aa199de2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.905033:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f5ace8b/0x5e4fb0a8aa199de2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.905041:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f5ace8b/0x5e4fb0a8aa199de2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.905064:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756342.905067:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d173de0e/0x5e4fb0a8aa199de9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.905112:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41497400 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756342.905115:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d173de0e/0x5e4fb0a8aa199de9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.905122:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d173de0e/0x5e4fb0a8aa199de9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.905132:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d173de0e/0x5e4fb0a8aa199de9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.905139:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d173de0e/0x5e4fb0a8aa199de9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.905152:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.905154:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.905155:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782756342.905654:0:14912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782756342.905660:0:14912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8955f92/0x5e4fb0a8aa199df0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.905669:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1782756342.905672:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756342.905676:0:14912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8955f92/0x5e4fb0a8aa199df0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.905686:0:14912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8955f92/0x5e4fb0a8aa199df0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.905700:0:14912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8955f92/0x5e4fb0a8aa199df0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.905708:0:14912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8955f92/0x5e4fb0a8aa199df0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.905941:0:14912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782756342.905983:0:14260:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782756342.905990:0:14260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8955f92/0x5e4fb0a8aa199df0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.905999:0:14260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41497600 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:1.0:1782756342.906003:0:14260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8955f92/0x5e4fb0a8aa199df0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.906012:0:14260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8955f92/0x5e4fb0a8aa199df0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.906026:0:14260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8955f92/0x5e4fb0a8aa199df0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.906034:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8955f92/0x5e4fb0a8aa199df0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756342.906066:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756342.906068:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756342.906069:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.910010:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782756342.911184:0:14912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782756342.911200:0:14912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e13bf38/0x5e4fb0a8aa199df7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.911224:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1782756342.911230:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756342.911239:0:14912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e13bf38/0x5e4fb0a8aa199df7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.911257:0:14912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e13bf38/0x5e4fb0a8aa199df7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.911271:0:14912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e13bf38/0x5e4fb0a8aa199df7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.911279:0:14912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e13bf38/0x5e4fb0a8aa199df7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.911316:0:14912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782756342.911332:0:14260:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756342.911339:0:14260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e13bf38/0x5e4fb0a8aa199df7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.911348:0:14260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41497000 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756342.911353:0:14260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e13bf38/0x5e4fb0a8aa199df7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.911364:0:14260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e13bf38/0x5e4fb0a8aa199df7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.911385:0:14260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e13bf38/0x5e4fb0a8aa199df7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.911394:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e13bf38/0x5e4fb0a8aa199df7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.911417:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.911419:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.911421:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782756342.911925:0:14912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782756342.911934:0:14912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa199dfe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.911944:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1782756342.911954:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756342.911960:0:14912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa199dfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.911971:0:14912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa199dfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.911979:0:14912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa199dfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.911986:0:14912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa199dfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.912000:0:14912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782756342.912009:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756342.912013:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa199dfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.912019:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41496600 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756342.912023:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa199dfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.912031:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa199dfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.912042:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa199dfe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.912060:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa199dfe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.912104:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.912106:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.912107:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782756342.912548:0:14912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782756342.912556:0:14912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0e1c17f/0x5e4fb0a8aa199e05 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.912566:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1782756342.912570:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756342.912575:0:14912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0e1c17f/0x5e4fb0a8aa199e05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.912584:0:14912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0e1c17f/0x5e4fb0a8aa199e05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.912592:0:14912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0e1c17f/0x5e4fb0a8aa199e05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.912600:0:14912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0e1c17f/0x5e4fb0a8aa199e05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.912617:0:14912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782756342.912627:0:14260:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756342.912637:0:14260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0e1c17f/0x5e4fb0a8aa199e05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.912644:0:14260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41496400 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756342.912647:0:14260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0e1c17f/0x5e4fb0a8aa199e05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.912655:0:14260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0e1c17f/0x5e4fb0a8aa199e05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.912668:0:14260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0e1c17f/0x5e4fb0a8aa199e05 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.912676:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0e1c17f/0x5e4fb0a8aa199e05 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.912693:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.912694:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.912696:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782756342.913185:0:14912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782756342.913192:0:14912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e24d5901/0x5e4fb0a8aa199e0c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.913202:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1782756342.913205:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756342.913210:0:14912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e24d5901/0x5e4fb0a8aa199e0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.913231:0:14912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e24d5901/0x5e4fb0a8aa199e0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.913240:0:14912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e24d5901/0x5e4fb0a8aa199e0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.913248:0:14912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e24d5901/0x5e4fb0a8aa199e0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.913266:0:14912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782756342.913277:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756342.913281:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e24d5901/0x5e4fb0a8aa199e0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.913288:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c40031000 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756342.913292:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e24d5901/0x5e4fb0a8aa199e0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.913300:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e24d5901/0x5e4fb0a8aa199e0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.913313:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e24d5901/0x5e4fb0a8aa199e0c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.913321:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e24d5901/0x5e4fb0a8aa199e0c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.913344:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.913345:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.913347:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782756342.917679:0:14912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782756342.917699:0:14912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067c01858/0x5e4fb0a8aa199e13 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.917733:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1782756342.917738:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756342.917745:0:14912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067c01858/0x5e4fb0a8aa199e13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.917763:0:14912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067c01858/0x5e4fb0a8aa199e13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.917775:0:14912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067c01858/0x5e4fb0a8aa199e13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.917784:0:14912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067c01858/0x5e4fb0a8aa199e13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.917803:0:14912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782756342.917818:0:14260:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756342.917824:0:14260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067c01858/0x5e4fb0a8aa199e13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.917852:0:14260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c40031400 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756342.917857:0:14260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067c01858/0x5e4fb0a8aa199e13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.917867:0:14260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067c01858/0x5e4fb0a8aa199e13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.917888:0:14260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067c01858/0x5e4fb0a8aa199e13 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.917896:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067c01858/0x5e4fb0a8aa199e13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.917919:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.917921:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.917923:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782756342.918651:0:14912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782756342.918659:0:14912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047e43915/0x5e4fb0a8aa199e1a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.918671:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1782756342.918675:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756342.918680:0:14912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047e43915/0x5e4fb0a8aa199e1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.918691:0:14912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047e43915/0x5e4fb0a8aa199e1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.918708:0:14912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047e43915/0x5e4fb0a8aa199e1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.918716:0:14912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047e43915/0x5e4fb0a8aa199e1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.918753:0:14912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782756342.918765:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756342.918769:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047e43915/0x5e4fb0a8aa199e1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.918777:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c40031600 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756342.918781:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047e43915/0x5e4fb0a8aa199e1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.918789:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047e43915/0x5e4fb0a8aa199e1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.918802:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047e43915/0x5e4fb0a8aa199e1a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.918810:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047e43915/0x5e4fb0a8aa199e1a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.918828:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.918837:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.918840:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782756342.919326:0:14912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782756342.919334:0:14912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098bd305f/0x5e4fb0a8aa199e21 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.919344:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1782756342.919348:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756342.919353:0:14912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098bd305f/0x5e4fb0a8aa199e21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.919363:0:14912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098bd305f/0x5e4fb0a8aa199e21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.919372:0:14912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098bd305f/0x5e4fb0a8aa199e21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.919380:0:14912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098bd305f/0x5e4fb0a8aa199e21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.919395:0:14912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782756342.919405:0:14260:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756342.919409:0:14260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098bd305f/0x5e4fb0a8aa199e21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.919415:0:14260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c40030c00 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756342.919418:0:14260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098bd305f/0x5e4fb0a8aa199e21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.919438:0:14260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098bd305f/0x5e4fb0a8aa199e21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.919450:0:14260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098bd305f/0x5e4fb0a8aa199e21 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.919457:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098bd305f/0x5e4fb0a8aa199e21 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.919472:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.919473:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.919475:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782756342.921669:0:14912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782756342.921688:0:14912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f2feb9e/0x5e4fb0a8aa199e28 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.921710:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1782756342.921716:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756342.921735:0:14912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f2feb9e/0x5e4fb0a8aa199e28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.921751:0:14912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f2feb9e/0x5e4fb0a8aa199e28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.921764:0:14912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f2feb9e/0x5e4fb0a8aa199e28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.921787:0:14912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f2feb9e/0x5e4fb0a8aa199e28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.921810:0:14912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782756342.921827:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756342.921834:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f2feb9e/0x5e4fb0a8aa199e28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.921843:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c40031c00 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756342.921849:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f2feb9e/0x5e4fb0a8aa199e28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.921860:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f2feb9e/0x5e4fb0a8aa199e28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.921879:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f2feb9e/0x5e4fb0a8aa199e28 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.921888:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f2feb9e/0x5e4fb0a8aa199e28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.921910:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.921912:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.921914:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782756342.922519:0:14912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782756342.922537:0:14912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be1891f9/0x5e4fb0a8aa199e2f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.922549:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1782756342.922553:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756342.922558:0:14912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be1891f9/0x5e4fb0a8aa199e2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.922569:0:14912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be1891f9/0x5e4fb0a8aa199e2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.922578:0:14912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be1891f9/0x5e4fb0a8aa199e2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.922586:0:14912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be1891f9/0x5e4fb0a8aa199e2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.922604:0:14912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782756342.922616:0:14260:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756342.922621:0:14260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be1891f9/0x5e4fb0a8aa199e2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.922628:0:14260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c40030000 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756342.922632:0:14260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be1891f9/0x5e4fb0a8aa199e2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.922640:0:14260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be1891f9/0x5e4fb0a8aa199e2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.922663:0:14260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be1891f9/0x5e4fb0a8aa199e2f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.922671:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be1891f9/0x5e4fb0a8aa199e2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.922690:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.922692:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.922695:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782756342.923357:0:14912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782756342.923366:0:14912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e24d5901/0x5e4fb0a8aa199e36 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.923377:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1782756342.923380:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756342.923384:0:14912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e24d5901/0x5e4fb0a8aa199e36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.923396:0:14912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e24d5901/0x5e4fb0a8aa199e36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.923405:0:14912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e24d5901/0x5e4fb0a8aa199e36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.923412:0:14912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e24d5901/0x5e4fb0a8aa199e36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.923443:0:14912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782756342.923455:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756342.923459:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e24d5901/0x5e4fb0a8aa199e36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.923466:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c40031000 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756342.923470:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e24d5901/0x5e4fb0a8aa199e36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.923480:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e24d5901/0x5e4fb0a8aa199e36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.923493:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e24d5901/0x5e4fb0a8aa199e36 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.923500:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e24d5901/0x5e4fb0a8aa199e36 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.923520:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.923522:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.923525:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782756342.924056:0:14912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782756342.924065:0:14912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d58f389/0x5e4fb0a8aa199e3d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.924103:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1782756342.924115:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756342.924119:0:14912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d58f389/0x5e4fb0a8aa199e3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.924131:0:14912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d58f389/0x5e4fb0a8aa199e3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.924140:0:14912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d58f389/0x5e4fb0a8aa199e3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.924149:0:14912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d58f389/0x5e4fb0a8aa199e3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.924168:0:14912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782756342.924180:0:14260:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756342.924185:0:14260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d58f389/0x5e4fb0a8aa199e3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.924193:0:14260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c40030200 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756342.924196:0:14260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d58f389/0x5e4fb0a8aa199e3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.924204:0:14260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d58f389/0x5e4fb0a8aa199e3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.924217:0:14260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d58f389/0x5e4fb0a8aa199e3d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.924237:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d58f389/0x5e4fb0a8aa199e3d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.924260:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.924263:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756342.924266:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782756342.925809:0:14912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782756342.925826:0:14912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002881e7ff/0x5e4fb0a8aa199e44 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.925842:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1782756342.925846:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756342.925852:0:14912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002881e7ff/0x5e4fb0a8aa199e44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.925865:0:14912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002881e7ff/0x5e4fb0a8aa199e44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.925875:0:14912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002881e7ff/0x5e4fb0a8aa199e44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.925883:0:14912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002881e7ff/0x5e4fb0a8aa199e44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756342.925913:0:14912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1782756342.926256:0:14912:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:3.0:1782756342.926393:0:14912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14295:x1869355222651904:12345-0@lo:5:osp-pre-0-0.0 Request processed in 60824us (60907us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756342.926411:0:14912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782756342.926484:0:14295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419f9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14295:1869355222651904:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1782756342.926504:0:14295:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1782756342.926571:0:14295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e11c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14295:1869355222652032:0@lo:5:osp-pre-0-0.0 00010000:00010000:0.0:1782756342.926702:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782756342.926712:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002881e7ff/0x5e4fb0a8aa199e44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756342.926742:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c40030a00 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:0.0:1782756342.926747:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002881e7ff/0x5e4fb0a8aa199e44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756342.926758:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002881e7ff/0x5e4fb0a8aa199e44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756342.926782:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002881e7ff/0x5e4fb0a8aa199e44 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756342.926790:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002881e7ff/0x5e4fb0a8aa199e44 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756342.926819:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756342.926821:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756342.926823:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782756342.926900:0:14295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756342.926963:0:14295:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a2cf600 going to sleep for 11 seconds 00000100:00100000:3.0:1782756342.926986:0:14912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222652032 00000100:00100000:3.0:1782756342.926994:0:14912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222652032 00000100:00100000:3.0:1782756342.927054:0:14911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782756342.927065:0:14911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14295:x1869355222652032:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1782756342.927150:0:14911:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1782756342.933414:0:14911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14295:x1869355222652032:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6339us (6504us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1782756342.933429:0:14911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782756342.933497:0:14295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e11c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14295:1869355222652032:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1782756342.933516:0:14295:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000004:00080000:1.0:1782756342.933804:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1782756343.884544:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782756344.146354:0:14307:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782756344.146363:0:14307:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782756344.146998:0:14307:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1782756344.147106:0:14307:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782756344.147142:0:14307:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:0.0:1782756344.909232:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782756345.895602:0:15274:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1782756345.932231:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782756346.402995:0:6627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1782756346.403029:0:6627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:0.0:1782756346.958019:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756347.980636:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756348.364390:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222652160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782756348.364498:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782756348.364880:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782756348.364892:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1782756348.364896:0:37:0:(import.c:65:import_set_state_nolock()) ffff9d3b41d9d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782756348.364902:0:37:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 384 00000100:00080000:2.0:1782756348.364907:0:37:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1782756348.364913:0:37:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d3b41d9d000 using connection 192.168.204.125@tcp/0@lo 00000100:00100000:2.0:1782756348.364936:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3c80fb9180 x1869355222652416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782756348.365365:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869355222652544:0@lo:400:kworker.0 00000100:00100000:1.0:1782756348.365405:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756348.365958:0:14914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222652160 00000100:00100000:2.0:1782756348.365966:0:14914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222652160 00000100:00100000:2.0:1782756348.366031:0:14914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782756348.366040:0:14914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222652160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782756348.366088:0:14914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782756348.366139:0:14914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222652160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756348.366146:0:14914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782756348.366190:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869355222652416:0@lo:8:kworker.0 00000100:00100000:2.0:1782756348.366219:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756348.366252:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869355222652672:0@lo:400:kworker.0 00000100:00100000:2.0:1782756348.366275:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782756348.366299:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782756348.366318:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222652416 00000100:00100000:2.0:1782756348.366322:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222652416 00000100:00100000:2.0:1782756348.366343:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782756348.366348:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1869355222652416:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1782756348.366366:0:14910:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1782756348.367019:0:14272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222652544 00000100:00100000:1.0:1782756348.367026:0:14272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222652544 00000100:00100000:1.0:1782756348.367360:0:14272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222652672 00000100:00100000:1.0:1782756348.367363:0:14272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222652672 00000100:00100000:1.0:1782756348.367383:0:14272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782756348.367389:0:14272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869355222652544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756348.367436:0:14272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869355222652544:12345-0@lo:400:kworker.0 Request processed in 47us (2031us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756348.367442:0:14272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782756348.367453:0:14272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782756348.367457:0:14272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869355222652672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756348.367484:0:14272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869355222652672:12345-0@lo:400:kworker.0 Request processed in 26us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756348.367489:0:14272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1782756348.367501:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782756348.367524:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3c80fb8700 x1869355222652672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782756364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756348.367537:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869355222652672:0@lo:400:kworker.0 00000100:00100000:1.0:1782756348.368354:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c7873c7-f262-4959-b911-d0a7cf42af86:3315:1869355222652288:0@lo:400:kworker.0 00010000:00080000:0.0:1782756348.368422:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3c80fb8380 x1869355222652544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782756364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756348.368449:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869355222652544:0@lo:400:kworker.0 00000100:00100000:0.0:1782756348.368486:0:3314:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1782756348.368504:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222652160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782756348.368587:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756348.368641:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222652288 00000100:00100000:0.0:1782756348.368645:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222652288 00000100:00100000:0.0:1782756348.368679:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782756348.368686:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c795c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+16:3315:x1869355222652288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756348.368727:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c795c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+16:3315:x1869355222652288:12345-0@lo:400:kworker.0 Request processed in 41us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756348.368733:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782756348.368760:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c7873c7-f262-4959-b911-d0a7cf42af86:3315:1869355222652288:0@lo:400:kworker.0 00000100:00100000:2.0:1782756348.385222:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1869355222652416:12345-0@lo:8:kworker.0 Request processed in 18863us (18993us total) trans 0 rc -19/-19 00000100:00100000:2.0:1782756348.385242:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1782756348.385312:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9d3b41d9d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782756348.385318:0:3313:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1782756348.385322:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869355222652416:0@lo:8:kworker.0 00010000:00010000:0.0:1782756349.007962:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756350.029300:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1782756350.645732:0:15578:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1782756350.645736:0:15578:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1782756350.645858:0:15578:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9d3c44e2d000 00000020:01000004:1.0:1782756350.645875:0:15578:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1782756350.645889:0:15578:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1782756350.645903:0:15578:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9d3c4aba4d40) 00000020:00000080:1.0:1782756350.645923:0:15578:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1782756350.659725:0:15578:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1782756350.660008:0:15578:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1782756350.661127:0:15578:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1782756350.661381:0:15578:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1782756350.661588:0:15578:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1782756350.661902:0:15578:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 293: rc = 0 00100000:10000000:1.0:1782756350.661993:0:15578:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 293: rc = 0 00100000:10000000:1.0:1782756350.662157:0:15578:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 293: rc = 0 00100000:10000000:1.0:1782756350.662655:0:15578:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:1.0:1782756350.663012:0:15578:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 769: rc = 0 00100000:10000000:1.0:1782756350.663351:0:15578:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 769: rc = 0 00100000:10000000:1.0:1782756350.663611:0:15578:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:1.0:1782756350.663851:0:15578:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:1.0:1782756350.664201:0:15578:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 769: rc = 0 00000020:00000080:1.0:1782756350.664787:0:15578:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1782756350.664801:0:15578:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1782756350.664812:0:15578:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5e4fb0a8aa199e52 00000020:01000004:1.0:1782756350.664820:0:15578:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1782756350.664842:0:15578:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.125@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1782756350.664846:0:15578:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1782756350.664852:0:15578:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1782756350.664883:0:15578:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1782756350.664887:0:15578:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.125@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1782756350.678857:0:15578:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.125@tcp ctxt 0 is initialized 00000020:01000004:1.0:1782756350.678896:0:15578:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.125@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1782756350.678902:0:15578:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1782756350.678904:0:15578:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782756350.678905:0:15578:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782756350.678906:0:15578:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782756350.678907:0:15578:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782756350.678909:0:15578:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782756350.678910:0:15578:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782756350.678912:0:15578:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782756350.678913:0:15578:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782756350.678918:0:15578:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1782756350.678920:0:15578:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782756350.678921:0:15578:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782756350.678922:0:15578:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782756350.678924:0:15578:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782756350.678925:0:15578:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782756350.678926:0:15578:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782756350.678927:0:15578:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782756350.679337:0:15578:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782756350.679338:0:15578:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782756350.679379:0:15578:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1782756350.679401:0:15578:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222652800:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1782756350.679473:0:15578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756350.679639:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222652800 00000100:00100000:0.0:1782756350.679647:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222652800 00000100:00100000:0.0:1782756350.679713:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782756350.679723:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c795c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+16:15578:x1869355222652800:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1782756350.679766:0:14266:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1782756350.679769:0:14266:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1782756350.679773:0:14266:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1782756350.679922:0:15578:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c821f33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782756350.690008:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c795c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+16:15578:x1869355222652800:12345-0@lo:253:mount.lustre.0 Request processed in 10275us (10523us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756350.690027:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782756350.690151:0:15578:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222652800:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782756350.690168:0:15578:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1782756350.690172:0:15578:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782756350.690174:0:15578:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782756350.690176:0:15578:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782756350.690177:0:15578:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782756350.690179:0:15578:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782756350.690180:0:15578:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782756350.690181:0:15578:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782756350.690183:0:15578:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782756350.690185:0:15578:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1782756350.690210:0:15578:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d3c44e2d000 from lustre-OST0001 10000000:01000000:2.0:1782756350.690237:0:15578:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1782756350.690240:0:15578:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1782756350.690248:0:15578:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d3c50023380 local copy 00010000:00010000:2.0:1782756350.690259:0:15578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c76e17a00/0x5e4fb0a8aa199bff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199c06 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756350.690525:0:15578:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fb9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222652928:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782756350.690586:0:15578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756350.690627:0:15578:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c490149c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782756350.690805:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222652928 00000100:00100000:0.0:1782756350.690819:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222652928 00000100:00100000:0.0:1782756350.690865:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782756350.690873:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c795c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+16:15578:x1869355222652928:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782756350.691144:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c795c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+16:15578:x1869355222652928:12345-0@lo:501:mount.lustre.0 Request processed in 271us (557us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782756350.691152:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782756350.691193:0:15578:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fb9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222652928:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1782756350.691213:0:15578:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1782756350.691358:0:15578:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1782756350.691365:0:15578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c76e17a00/0x5e4fb0a8aa199bff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199c06 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756350.691374:0:15578:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c76e17a00/0x5e4fb0a8aa199bff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199c06 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782756350.691399:0:15578:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d3c44e2d000 10000000:01000000:0.0:1782756350.691404:0:15578:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1782756350.691409:0:15578:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1782756350.691411:0:15578:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782756350.691416:0:15578:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1782756350.691419:0:15578:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1782756350.691442:0:15578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c76e16e00/0x5e4fb0a8aa199e59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756350.691451:0:15578:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c76e16e00/0x5e4fb0a8aa199e59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756350.691460:0:15578:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c76e16e00/0x5e4fb0a8aa199e59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756350.691481:0:15578:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222653056:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782756350.691509:0:15578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756350.691533:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222653056 00000100:00100000:0.0:1782756350.691537:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222653056 00000100:00100000:0.0:1782756350.691696:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782756350.691705:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c795c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+16:15578:x1869355222653056:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782756350.691715:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756350.691728:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c76e17e00/0x5e4fb0a8aa199e60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa199e59 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756350.691751:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c76e17e00/0x5e4fb0a8aa199e60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199e59 expref: 17 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756350.691762:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c76e17e00/0x5e4fb0a8aa199e60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199e59 expref: 17 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756350.691771:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c76e17e00, rc 0) 00000100:00100000:0.0:1782756350.691796:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c795c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+17:15578:x1869355222653056:12345-0@lo:101:mount.lustre.0 Request processed in 93us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756350.691802:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782756350.691836:0:15578:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c5811bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1782756350.691850:0:15578:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222653056:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782756350.691863:0:15578:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c76e16e00/0x5e4fb0a8aa199e59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199e60 expref: -99 pid: 15578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756350.691871:0:15578:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c76e16e00/0x5e4fb0a8aa199e59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa199e60 expref: -99 pid: 15578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782756350.692877:0:15578:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1782756350.694148:0:15578:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782756350.694403:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1782756350.694533:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1782756350.694647:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1782756350.694703:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1782756350.694741:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1782756350.694776:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1782756350.694843:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1782756350.694851:0:15578:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1782756350.695012:0:15578:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222653184:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782756350.695161:0:15578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756350.695257:0:15578:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a8c9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782756350.695304:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222653184 00000100:00100000:1.0:1782756350.695311:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222653184 00000100:00100000:1.0:1782756350.695394:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782756350.695403:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c795c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+17:15578:x1869355222653184:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782756350.696066:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c795c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+17:15578:x1869355222653184:12345-0@lo:501:mount.lustre.0 Request processed in 662us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756350.696094:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782756350.696255:0:15578:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222653184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782756350.696303:0:15578:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222653312:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782756350.696346:0:15578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756350.696375:0:15578:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c490149c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782756350.696590:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222653312 00000100:00100000:3.0:1782756350.696596:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222653312 00000100:00100000:3.0:1782756350.696736:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782756350.696811:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c795c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+17:15578:x1869355222653312:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782756350.697138:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c795c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+17:15578:x1869355222653312:12345-0@lo:503:mount.lustre.0 Request processed in 393us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756350.697146:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782756350.697169:0:15578:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222653312:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1782756350.700681:0:15578:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782756350.700779:0:15578:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222653440:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782756350.700872:0:15578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756350.700977:0:15578:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c490149c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782756350.705217:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222653440 00000100:00100000:1.0:1782756350.705231:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222653440 00000100:00100000:0.0:1782756350.705408:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782756350.705419:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c795c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+17:15578:x1869355222653440:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782756350.706231:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c795c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+17:15578:x1869355222653440:12345-0@lo:502:mount.lustre.0 Request processed in 811us (5355us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756350.706240:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782756350.706346:0:15578:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222653440:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782756350.706633:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1782756350.706690:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1782756350.706727:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1782756350.706811:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1782756350.706853:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1782756350.706890:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1782756350.707154:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1782756350.707216:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1782756350.707266:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1782756350.707313:0:15578:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222653568:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782756350.707369:0:15578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756350.707405:0:15578:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c490149c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782756350.707418:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222653568 00000100:00100000:3.0:1782756350.707424:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222653568 00000100:00100000:3.0:1782756350.707492:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782756350.707502:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c795c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+17:15578:x1869355222653568:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782756350.707688:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c795c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+17:15578:x1869355222653568:12345-0@lo:502:mount.lustre.0 Request processed in 187us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756350.707694:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782756350.707870:0:15578:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222653568:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782756350.707956:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1782756350.707968:0:15578:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1782756350.709370:0:15579:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782756350.709380:0:15579:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1782756350.709385:0:15579:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756350.709388:0:15579:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1782756350.709394:0:15579:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782756350.709410:0:15579:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9d3c78fd4d40) 00000020:00000080:2.0:1782756350.709602:0:15579:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1782756350.709611:0:15579:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1782756350.709757:0:15579:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3c44e2d000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1782756350.709765:0:15579:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782756350.709778:0:15579:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5e4fb0a8aa199e6e 00010000:00010000:2.0:1782756350.713917:0:15579:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1782756350.714867:0:15579:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1782756350.717135:0:15579:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1782756350.718766:0:15579:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1782756350.718777:0:15579:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782756350.718782:0:15579:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756350.718785:0:15579:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1782756350.718791:0:15579:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782756350.718796:0:15579:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756350.718797:0:15579:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782756350.718800:0:15579:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782756350.718802:0:15579:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1782756350.718804:0:15579:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782756350.718807:0:15579:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756350.718808:0:15579:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1782756350.718810:0:15579:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782756350.718812:0:15579:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756350.718814:0:15579:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1782756350.718817:0:15579:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1782756350.718867:0:15579:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782756350.718871:0:15579:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782756350.718873:0:15579:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1782756350.718876:0:15579:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1782756350.719110:0:15578:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1782756350.719140:0:15578:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1782756350.719167:0:15578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c76e16e00/0x5e4fb0a8aa199e59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199e60 expref: -99 pid: 15578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756350.719180:0:15578:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c76e16e00/0x5e4fb0a8aa199e59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199e60 expref: -99 pid: 15578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756350.719189:0:15578:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9d3c44e2d000 from 1 10000000:01000000:1.0:1782756350.719191:0:15578:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782756350.719229:0:15578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef4800/0x5e4fb0a8aa199e75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756350.719238:0:15578:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef4800/0x5e4fb0a8aa199e75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756350.719249:0:15578:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef4800/0x5e4fb0a8aa199e75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756350.719286:0:15578:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222653696:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782756350.719354:0:15578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756350.719386:0:15578:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a7003c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782756350.719598:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222653696 00000100:00100000:3.0:1782756350.719606:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222653696 00000100:00100000:3.0:1782756350.719657:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782756350.719677:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c795c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+17:15578:x1869355222653696:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782756350.719689:0:14267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756350.719701:0:14267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c40031000/0x5e4fb0a8aa199e7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa199e75 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756350.719723:0:14267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c40031000/0x5e4fb0a8aa199e7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199e75 expref: 18 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756350.719733:0:14267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c40031000/0x5e4fb0a8aa199e7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199e75 expref: 18 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756350.719742:0:14267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c40031000, rc 0) 00000100:00100000:3.0:1782756350.719780:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c795c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+18:15578:x1869355222653696:12345-0@lo:101:mount.lustre.0 Request processed in 114us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756350.719800:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1782756350.720033:0:15578:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222653696:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782756350.720047:0:15578:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef4800/0x5e4fb0a8aa199e75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199e7c expref: -99 pid: 15578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756350.720061:0:15578:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef4800/0x5e4fb0a8aa199e75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa199e7c expref: -99 pid: 15578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782756350.720820:0:15578:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1782756350.721775:0:15578:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782756350.722029:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1782756350.722110:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1782756350.722176:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1782756350.722184:0:15578:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1782756350.722259:0:15578:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222653824:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782756350.723622:0:15578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756350.724469:0:15578:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a7003c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782756350.725727:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222653824 00000100:00100000:2.0:1782756350.725738:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222653824 00000100:00100000:2.0:1782756350.725962:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782756350.725974:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c795c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+18:15578:x1869355222653824:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782756350.726313:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c795c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+18:15578:x1869355222653824:12345-0@lo:501:mount.lustre.0 Request processed in 341us (2693us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756350.726320:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782756350.726611:0:15578:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222653824:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782756350.726662:0:15578:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222653952:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782756350.726781:0:15578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756350.726844:0:15578:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a7003c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782756350.727771:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222653952 00000100:00100000:0.0:1782756350.727780:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222653952 00000100:00100000:0.0:1782756350.727820:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782756350.727828:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c795c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+18:15578:x1869355222653952:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782756350.728536:0:15578:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222653952:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782756350.728697:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c795c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+18:15578:x1869355222653952:12345-0@lo:503:mount.lustre.0 Request processed in 681us (1727us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756350.728708:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000040:00080000:1.0:1782756350.729048:0:15578:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782756350.729149:0:15578:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222654080:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782756350.729195:0:15578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756350.729230:0:15578:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a7003c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782756350.729312:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222654080 00000100:00100000:0.0:1782756350.729323:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222654080 00000100:00100000:0.0:1782756350.729362:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782756350.729371:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c795c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+18:15578:x1869355222654080:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782756350.729841:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c795c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+18:15578:x1869355222654080:12345-0@lo:502:mount.lustre.0 Request processed in 469us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756350.729849:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782756350.731196:0:15578:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222654080:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782756350.731513:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1782756350.731601:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1782756350.731653:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1782756350.731700:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1782756350.731741:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1782756350.731795:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1782756350.731836:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1782756350.731888:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1782756350.731924:0:15578:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222654208:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782756350.731984:0:15578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756350.732030:0:15578:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a7003c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782756350.732415:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222654208 00000100:00100000:3.0:1782756350.732422:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222654208 00000100:00100000:3.0:1782756350.732499:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782756350.732509:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c795c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+18:15578:x1869355222654208:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782756350.732725:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c795c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+18:15578:x1869355222654208:12345-0@lo:502:mount.lustre.0 Request processed in 217us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756350.732733:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782756350.732803:0:15578:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222654208:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782756350.732897:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1782756350.732908:0:15578:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1782756350.734002:0:15583:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782756350.734013:0:15583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782756350.734015:0:15583:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1782756350.734023:0:15583:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d3c44e2d000 00000020:00000080:3.0:1782756350.734025:0:15583:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782756350.734032:0:15583:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782756350.734035:0:15583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782756350.734036:0:15583:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1782756350.734038:0:15583:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782756350.734041:0:15583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782756350.734042:0:15583:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782756350.734045:0:15583:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d3c44e2d000 00000020:00000080:3.0:1782756350.734046:0:15583:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782756350.734186:0:15583:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782756350.734190:0:15583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782756350.734191:0:15583:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1782756350.734194:0:15583:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782756350.734196:0:15583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782756350.734198:0:15583:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1782756350.734201:0:15583:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d3c44e2d000 00000020:00000080:3.0:1782756350.734203:0:15583:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782756350.734235:0:15583:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782756350.734243:0:15583:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782756350.734245:0:15583:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1782756350.734249:0:15583:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1782756350.734555:0:15578:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1782756350.734597:0:15578:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782756350.734648:0:15578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef4800/0x5e4fb0a8aa199e75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199e7c expref: -99 pid: 15578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756350.734660:0:15578:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef4800/0x5e4fb0a8aa199e75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199e7c expref: -99 pid: 15578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782756350.734713:0:15578:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782756350.734716:0:15578:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d3c44e2d000 10000000:01000000:1.0:1782756350.734720:0:15578:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d3c44e2d000 10000000:01000000:1.0:1782756350.734724:0:15578:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782756350.734729:0:15578:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9d3c44e2d000 from 1 10000000:01000000:1.0:1782756350.734732:0:15578:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782756350.734765:0:15578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef5400/0x5e4fb0a8aa199e83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756350.734774:0:15578:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef5400/0x5e4fb0a8aa199e83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756350.734794:0:15578:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef5400/0x5e4fb0a8aa199e83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756350.734816:0:15578:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222654336:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782756350.734871:0:15578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756350.735004:0:15578:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a700d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782756350.735060:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222654336 00000100:00100000:2.0:1782756350.735372:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222654336 00000100:00100000:3.0:1782756350.735605:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1782756350.735617:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80995850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+18:15578:x1869355222654336:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782756350.735633:0:14267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756350.735647:0:14267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c40030200/0x5e4fb0a8aa199e8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa199e83 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756350.735782:0:14267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c40030200/0x5e4fb0a8aa199e8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199e83 expref: 19 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756350.735794:0:14267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c40030200/0x5e4fb0a8aa199e8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199e83 expref: 19 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756350.735802:0:14267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c40030200, rc 0) 00000100:00100000:3.0:1782756350.735854:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80995850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+19:15578:x1869355222654336:12345-0@lo:101:mount.lustre.0 Request processed in 240us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756350.735861:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782756350.735937:0:15578:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222654336:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782756350.735952:0:15578:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef5400/0x5e4fb0a8aa199e83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199e8a expref: -99 pid: 15578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756350.735960:0:15578:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef5400/0x5e4fb0a8aa199e83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa199e8a expref: -99 pid: 15578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782756350.736558:0:15578:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1782756350.736949:0:15578:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782756350.737204:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1782756350.737243:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1782756350.737271:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1782756350.737300:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1782756350.737319:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1782756350.737356:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1782756350.737375:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1782756350.737391:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1782756350.737414:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1782756350.737431:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1782756350.737461:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1782756350.737510:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1782756350.737546:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1782756350.737592:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1782756350.738037:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1782756350.738113:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1782756350.738155:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1782756350.738216:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1782756350.738250:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1782756350.738356:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1782756350.738410:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1782756350.740362:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1782756350.740561:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1782756350.740711:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1782756350.741050:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1782756350.741177:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1782756350.741339:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1782756350.741407:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1782756350.742557:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1782756350.742727:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1782756350.742776:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1782756350.742812:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1782756350.742848:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1782756350.742905:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1782756350.742943:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1782756350.742989:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1782756350.743025:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1782756350.743150:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1782756350.743158:0:15578:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1782756350.743262:0:15578:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222654464:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782756350.744431:0:15578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756350.744475:0:15578:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a700d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782756350.744962:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222654464 00000100:00100000:3.0:1782756350.744970:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222654464 00000100:00100000:3.0:1782756350.745020:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782756350.745030:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fbb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+19:15578:x1869355222654464:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782756350.745662:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fbb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+19:15578:x1869355222654464:12345-0@lo:501:mount.lustre.0 Request processed in 632us (1234us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756350.745667:0:15578:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222654464:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782756350.745710:0:15578:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222654592:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782756350.745742:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782756350.745758:0:15578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756350.745779:0:15578:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a700d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782756350.745786:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222654592 00000100:00100000:3.0:1782756350.745792:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222654592 00000100:00100000:3.0:1782756350.745813:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782756350.745827:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fbb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+19:15578:x1869355222654592:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782756350.746137:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fbb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+19:15578:x1869355222654592:12345-0@lo:503:mount.lustre.0 Request processed in 311us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756350.746144:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782756350.746675:0:15578:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222654592:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1782756350.747309:0:15578:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782756350.747378:0:15578:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222654720:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782756350.747432:0:15578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756350.747544:0:15578:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a700d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782756350.747629:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222654720 00000100:00100000:3.0:1782756350.747635:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222654720 00000100:00100000:3.0:1782756350.747670:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782756350.747678:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fbb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+19:15578:x1869355222654720:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782756350.748103:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fbb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+19:15578:x1869355222654720:12345-0@lo:502:mount.lustre.0 Request processed in 424us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756350.748111:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782756350.748203:0:15578:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222654720:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782756350.748694:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1782756350.748744:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1782756350.748774:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1782756350.748820:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1782756350.748863:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1782756350.749038:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1782756350.749170:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1782756350.749206:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1782756350.749247:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1782756350.749278:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1782756350.749307:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1782756350.749348:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1782756350.749400:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1782756350.749438:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1782756350.749484:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1782756350.749516:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1782756350.749547:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1782756350.750535:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1782756350.750622:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1782756350.750698:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1782756350.750789:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1782756350.750865:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1782756350.750911:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1782756350.750979:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1782756350.751026:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1782756350.751138:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1782756350.751226:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1782756350.751287:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1782756350.751349:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1782756350.751440:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1782756350.751487:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1782756350.751522:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1782756350.751579:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1782756350.751645:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1782756350.751686:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1782756350.751740:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1782756350.751769:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1782756350.751793:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1782756350.751845:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1782756350.751871:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1782756350.751910:0:15578:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222654848:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782756350.751981:0:15578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756350.752111:0:15578:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a700d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782756350.752172:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222654848 00000100:00100000:2.0:1782756350.752179:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222654848 00000100:00100000:2.0:1782756350.752231:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1782756350.752241:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fbb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+19:15578:x1869355222654848:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782756350.752547:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fbb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+19:15578:x1869355222654848:12345-0@lo:502:mount.lustre.0 Request processed in 307us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756350.752555:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782756350.752643:0:15578:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222654848:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782756350.752713:0:15578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1782756350.752725:0:15578:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1782756350.754010:0:15588:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1782756350.754036:0:15588:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9d3b42f499c0) 00000020:00000080:1.0:1782756350.754059:0:15588:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1782756350.754417:0:15588:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d3c44e2d000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1782756350.754423:0:15588:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d3c44e2d000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1782756350.754426:0:15588:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9d3c44e2d000 3 00010000:00080000:1.0:1782756350.754470:0:15588:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d3c7fbd8800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.125@tcp at head 00010000:00010000:1.0:1782756350.756294:0:15588:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1782756350.756395:0:15588:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1782756350.756433:0:15588:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782756350.756459:0:15588:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5e4fb0a8aa199e98 00000100:00080000:1.0:1782756350.756469:0:15588:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782756350.756474:0:15588:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d3c7fbd8800 using connection 192.168.204.125@tcp/0@lo 00000100:00100000:1.0:1782756350.756512:0:15588:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3c78e2aa00 x1869355222654976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782756350.756552:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1869355222654976:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1782756350.756636:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756350.756711:0:14272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222654976 00000100:00100000:1.0:1782756350.756718:0:14272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222654976 00000100:00100000:1.0:1782756350.756752:0:14272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782756350.756760:0:14272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1869355222654976:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1782756350.756784:0:14272:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 391 last 0 00000020:00000080:1.0:1782756350.756830:0:14272:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5e4fb0a8aa199e9f 00000004:00100000:1.0:1782756350.756846:0:14272:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782756350.756882:0:14272:0:(import.c:65:import_set_state_nolock()) ffff9d3b421c7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782756350.756939:0:14272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869355222654976:12345-0@lo:38:llog_process_th.0 Request processed in 176us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756350.756948:0:14272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1782756350.756996:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3c78e2aa00 x1869355222654976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782756360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782756350.757006:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782756350.757014:0:3313:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1782756350.757029:0:3313:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1782756350.757035:0:3313:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1782756350.757038:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9d3c7fbd8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1782756350.757048:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1869355222654976:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1782756350.757101:0:15588:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1782756350.757156:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782756350.757160:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1782756350.757162:0:37:0:(import.c:65:import_set_state_nolock()) ffff9d3b41d9d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782756350.757167:0:37:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 389 00000100:00080000:1.0:1782756350.757172:0:37:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1782756350.757177:0:37:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d3b41d9d000 using connection 192.168.204.125@tcp/0@lo 00000100:00100000:1.0:1782756350.757191:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3c78e29180 x1869355222655232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782756350.757896:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222655104:0@lo:400:kworker.0 00000100:00100000:1.0:1782756350.757912:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869355222655360:0@lo:400:kworker.0 00000100:00100000:0.0:1782756350.759726:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756350.759795:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869355222655488:0@lo:400:kworker.0 00000100:00100000:0.0:1782756350.759837:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756350.759871:0:14911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222655104 00000100:00100000:0.0:1782756350.759878:0:14911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222655104 00000100:00100000:0.0:1782756350.759926:0:14911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782756350.759936:0:14911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222655104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756350.759988:0:14911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222655104:12345-0@lo:400:kworker.0 Request processed in 54us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756350.759996:0:14911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782756350.760020:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222655488 00000100:00100000:0.0:1782756350.760023:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222655488 00000100:00100000:0.0:1782756350.760053:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782756350.760061:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869355222655488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756350.760226:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756350.760265:0:14273:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1782756350.760274:0:14273:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1782756350.760289:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869355222655232:0@lo:8:kworker.0 00000100:00100000:1.0:1782756350.760337:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782756350.761228:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782756350.761235:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782756350.761253:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222655232 00000100:00100000:2.0:1782756350.761259:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222655232 00000100:00100000:2.0:1782756350.761292:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782756350.761298:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1869355222655232:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1782756350.761361:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1869355222655232:12345-0@lo:8:kworker.0 Request processed in 61us (1024us total) trans 0 rc -11/-11 00000100:00100000:2.0:1782756350.761366:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782756350.761396:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782756350.761403:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9d3b41d9d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782756350.761408:0:3313:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1782756350.761410:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869355222655232:0@lo:8:kworker.0 00000100:00100000:0.0:1782756350.761801:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869355222655488:12345-0@lo:400:kworker.0 Request processed in 55us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756350.761810:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782756350.761827:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222655360 00000100:00100000:0.0:1782756350.761830:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222655360 00000100:00100000:0.0:1782756350.761849:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782756350.761862:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869355222655360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756350.761909:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869355222655360:12345-0@lo:400:kworker.0 Request processed in 49us (1684us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756350.761914:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1782756350.761946:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3c78e29f80 x1869355222655360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782756366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756350.761958:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869355222655360:0@lo:400:kworker.0 00010000:00080000:0.0:1782756350.762005:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d3c78e28e00 x1869355222655488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782756366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756350.762014:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869355222655488:0@lo:400:kworker.0 00000100:00100000:0.0:1782756350.762046:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222655104:0@lo:400:kworker.0 00000040:00080000:1.0:1782756350.763769:0:15588:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1782756350.764664:0:15578:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1782756350.764697:0:15578:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782756350.764727:0:15578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef5400/0x5e4fb0a8aa199e83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199e8a expref: -99 pid: 15578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756350.764741:0:15578:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef5400/0x5e4fb0a8aa199e83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199e8a expref: -99 pid: 15578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782756350.764798:0:15578:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782756350.764801:0:15578:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782756350.764802:0:15578:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782756350.764804:0:15578:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782756350.764805:0:15578:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782756350.764807:0:15578:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782756350.764808:0:15578:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782756350.764810:0:15578:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782756350.764811:0:15578:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782756350.764816:0:15578:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1782756350.764818:0:15578:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782756350.764820:0:15578:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782756350.764821:0:15578:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782756350.764822:0:15578:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782756350.764823:0:15578:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782756350.764824:0:15578:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782756350.764825:0:15578:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782756350.764826:0:15578:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782756350.764827:0:15578:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782756350.764852:0:15578:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1782756350.764873:0:15578:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fb8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222655616:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782756350.765018:0:15578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756350.765063:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222655616 00000100:00100000:2.0:1782756350.765067:0:15578:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76d17a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782756350.765069:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222655616 00000100:00100000:0.0:1782756350.765183:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782756350.765191:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fbb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+19:15578:x1869355222655616:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1782756350.765215:0:14265:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1782756350.765227:0:14265:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1782756350.791749:0:14265:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1782756350.791765:0:14265:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1782756350.791914:0:14288:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1782756350.791919:0:14288:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1782756350.791938:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d3c78ef4600/0x5e4fb0a8aa199ea6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756350.791965:0:14288:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c78ef4200/0x5e4fb0a8aa199d80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199d79 expref: 19 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756350.791982:0:14288:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d3c78ef4600/0x5e4fb0a8aa199ea6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756350.792014:0:14288:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c78ef4200/0x5e4fb0a8aa199d80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa199d79 expref: 19 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756350.792025:0:14288:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3c78ef4200/0x5e4fb0a8aa199d80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa199d79 expref: 19 pid: 14265 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756350.792036:0:14288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e28380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14288:1869355222655744:0@lo:104: 00000100:00100000:1.0:1782756350.792135:0:14288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756350.792173:0:14288:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c4a700b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782756350.792327:0:14256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222655744 00000100:00100000:2.0:1782756350.792334:0:14256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222655744 00000100:00100000:2.0:1782756350.792412:0:14256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782756350.792421:0:14256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c7873c7-f262-4959-b911-d0a7cf42af86+3:14288:x1869355222655744:12345-0@lo:104: 00010000:00010000:2.0:1782756350.792443:0:14256:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63d800/0x5e4fb0a8aa199d79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa199d80 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756350.792506:0:14256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782756350.792512:0:14256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c7873c7-f262-4959-b911-d0a7cf42af86+3:14288:x1869355222655744:12345-0@lo:104: Request processed in 93us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756350.792529:0:14256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782756350.792548:0:14288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e28380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14288:1869355222655744:0@lo:104: 00010000:00010000:3.0:1782756350.792585:0:14288:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d3c78ef4600/0x5e4fb0a8aa199ea6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756350.792640:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782756350.792646:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63d800/0x5e4fb0a8aa199d79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa199d80 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756350.792654:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d800 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:2.0:1782756350.792658:0:14261:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63d800/0x5e4fb0a8aa199d79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa199d80 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756350.792760:0:14261:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63d800/0x5e4fb0a8aa199d79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa199d80 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782756350.792769:0:14261:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63d800/0x5e4fb0a8aa199d79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa199d80 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782756350.792775:0:14261:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1782756350.792872:0:14261:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63d800/0x5e4fb0a8aa199d79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa199d80 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756350.792878:0:14261:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1782756350.792920:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c7873c7-f262-4959-b911-d0a7cf42af86:3317:1869355222655872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782756350.792954:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756350.793013:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222655872 00000100:00100000:3.0:1782756350.793018:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222655872 00010000:00010000:3.0:1782756350.793036:0:14257:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c78ef4200/0x5e4fb0a8aa199d80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa199d79 expref: 20 pid: 14265 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756350.793060:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782756350.793067:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c7873c7-f262-4959-b911-d0a7cf42af86+20:3317:x1869355222655872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782756350.793095:0:14257:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756350.793099:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63d800/0x5e4fb0a8aa199d79 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa199d80 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756350.793101:0:14257:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c78ef4200/0x5e4fb0a8aa199d80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa199d79 expref: 20 pid: 14265 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756350.793108:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63d800/0x5e4fb0a8aa199d79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa199d80 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756350.793111:0:14257:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c78ef4200/0x5e4fb0a8aa199d80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa199d79 expref: 20 pid: 14265 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756350.793124:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756350.793126:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756350.793127:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756350.793130:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c78ef4200/0x5e4fb0a8aa199d80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa199d79 expref: 20 pid: 14265 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756350.793142:0:14257:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d3c78ef4600/0x5e4fb0a8aa199ea6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756350.793150:0:14257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c78ef4600/0x5e4fb0a8aa199ea6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1782756350.793163:0:14257:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002084870s 00010000:00010000:3.0:1782756350.793167:0:14257:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3c78ef4600/0x5e4fb0a8aa199ea6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756350.793174:0:14257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3c78ef4600/0x5e4fb0a8aa199ea6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756350.793180:0:14257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d3c78ef4600/0x5e4fb0a8aa199ea6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756350.793187:0:14257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d3c78ef4600/0x5e4fb0a8aa199ea6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756350.793192:0:14257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4600 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756350.793196:0:14257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d3c78ef4600/0x5e4fb0a8aa199ea6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756350.793203:0:14257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d3c78ef4600/0x5e4fb0a8aa199ea6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756350.793224:0:14257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d3c78ef4600/0x5e4fb0a8aa199ea6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756350.793239:0:14257:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782756350.793246:0:14288:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d3c78ef4600/0x5e4fb0a8aa199ea6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756350.793259:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d3c78ef4600/0x5e4fb0a8aa199ea6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756350.793266:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c78ef4600/0x5e4fb0a8aa199ea6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756350.793283:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c7873c7-f262-4959-b911-d0a7cf42af86+19:3317:x1869355222655872:12345-0@lo:103:ldlm_bl.0 Request processed in 217us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756350.793317:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c7873c7-f262-4959-b911-d0a7cf42af86:3317:1869355222655872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782756350.793428:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782756350.798352:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fbb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+18:15578:x1869355222655616:12345-0@lo:253:mount.lustre.0 Request processed in 33149us (33323us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756350.798367:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782756350.798391:0:15578:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fb8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c7873c7-f262-4959-b911-d0a7cf42af86:15578:1869355222655616:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782756350.798405:0:15578:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1782756350.798408:0:15578:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782756350.798410:0:15578:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782756350.798411:0:15578:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782756350.798413:0:15578:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782756350.798414:0:15578:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782756350.798415:0:15578:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782756350.798417:0:15578:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782756350.798423:0:15578:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782756350.798424:0:15578:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782756350.798445:0:15578:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1782756350.803673:0:15578:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1782756350.803883:0:15578:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1782756350.804067:0:15578:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1782756350.804298:0:15578:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1782756350.804461:0:15578:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1782756350.804720:0:15578:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1782756350.806109:0:15578:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1782756350.850247:0:15578:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1782756350.850255:0:15578:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1782756350.850283:0:15578:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1782756350.850344:0:15578:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.125@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1782756350.850362:0:15578:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1782756350.850387:0:15578:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1782756351.052251:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756352.081040:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782756352.845298:0:14269:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1782756352.845306:0:14269:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9d3c7fb26000 from 8 10000000:01000000:3.0:1782756352.845311:0:14269:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782756352.845576:0:14269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c40030000/0x5e4fb0a8aa199ead lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756352.845591:0:14269:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c40030000/0x5e4fb0a8aa199ead lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756352.845621:0:14269:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c40030000/0x5e4fb0a8aa199ead lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756352.845650:0:14269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e10a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222656000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782756352.845725:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756352.845795:0:14269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c490149c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782756352.846094:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222656000 00000100:00100000:2.0:1782756352.846104:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222656000 00000100:00100000:2.0:1782756352.846156:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782756352.846166:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fbb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+18:14269:x1869355222656000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782756352.846185:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756352.846201:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4a63c200/0x5e4fb0a8aa199eb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa199ead expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756352.846227:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4a63c200/0x5e4fb0a8aa199eb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199ead expref: 19 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756352.846239:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4a63c200/0x5e4fb0a8aa199eb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199ead expref: 19 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756352.846256:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63c200, rc 0) 00000100:00100000:2.0:1782756352.846305:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fbb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+19:14269:x1869355222656000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756352.846313:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782756352.846347:0:14269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e10a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222656000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782756352.846364:0:14269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c40030000/0x5e4fb0a8aa199ead lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199eb4 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756352.846374:0:14269:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c40030000/0x5e4fb0a8aa199ead lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa199eb4 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756352.846584:0:14269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e10a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222656128:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1782756352.846619:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756352.846649:0:14269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c490149c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782756352.847189:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222656128 00000100:00100000:0.0:1782756352.847201:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222656128 00000100:00100000:0.0:1782756352.847238:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1782756352.847247:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fbb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+19:14269:x1869355222656128:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1782756352.847262:0:14265:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782756352.847278:0:14265:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782756352.847281:0:14265:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1782756352.847374:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fbb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+19:14269:x1869355222656128:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 127us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756352.847382:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1782756352.847489:0:14269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e10a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222656128:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1782756352.847564:0:14269:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782756352.847573:0:14269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c40030000/0x5e4fb0a8aa199ead lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199eb4 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756352.847592:0:14269:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c40030000/0x5e4fb0a8aa199ead lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa199eb4 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756353.100393:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756353.487570:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222656256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782756353.488950:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756353.489101:0:14914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222656256 00000100:00100000:0.0:1782756353.489110:0:14914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222656256 00000100:00100000:0.0:1782756353.489223:0:14914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782756353.489236:0:14914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222656256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782756353.489276:0:14914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782756353.489338:0:14914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222656256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756353.489357:0:14914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1782756353.489380:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782756353.489425:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222656256:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782756354.128428:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782756354.380832:0:14307:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1782756355.148891:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782756355.390966:0:15934:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1782756356.050665:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782756356.050673:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1782756356.050677:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d3b41d9d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782756356.050692:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d3b41d9d000 using connection 192.168.204.125@tcp/0@lo 00000100:00100000:0.0:1782756356.050694:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c7873c7-f262-4959-b911-d0a7cf42af86:3315:1869355222656384:0@lo:400:kworker.0 00000100:00100000:3.0:1782756356.050719:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d3c78e12680 x1869355222656640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782756356.050800:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222656896:0@lo:400:kworker.0 00000100:00100000:0.0:1782756356.050825:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756356.051238:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869355222656640:0@lo:8:kworker.0 00000100:00100000:0.0:1782756356.051728:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869355222657024:0@lo:400:kworker.0 00000100:00100000:3.0:1782756356.054591:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756356.054674:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222656512:0@lo:400:kworker.0 00000100:00100000:3.0:1782756356.054721:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756356.054743:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782756356.054750:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869355222656768:0@lo:400:kworker.0 00000100:00100000:3.0:1782756356.054769:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756356.054816:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222656896 00000100:00100000:3.0:1782756356.054823:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222656896 00000100:00100000:3.0:1782756356.054881:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222656768 00000100:00100000:3.0:1782756356.054884:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222656768 00000100:00100000:3.0:1782756356.054906:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782756356.054916:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222656896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782756356.054975:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869355222656896:12345-0@lo:400:kworker.0 Request processed in 61us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756356.054983:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782756356.055000:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782756356.055006:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869355222656768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782756356.055034:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869355222656768:12345-0@lo:400:kworker.0 Request processed in 29us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756356.055039:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782756356.055057:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222656512 00000100:00100000:3.0:1782756356.055060:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222656512 00000100:00100000:3.0:1782756356.055122:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782756356.055129:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222656512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782756356.055164:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222656512:12345-0@lo:400:kworker.0 Request processed in 37us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756356.055170:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1782756356.055187:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782756356.055197:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782756356.055232:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c78e10000 x1869355222656896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782756372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756356.055246:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869355222656896:0@lo:400:kworker.0 00010000:00080000:3.0:1782756356.059032:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c78e10700 x1869355222656768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782756372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782756356.059055:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869355222656768:0@lo:400:kworker.0 00000100:00100000:3.0:1782756356.059088:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222656512:0@lo:400:kworker.0 00000100:00100000:3.0:1782756356.059532:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222656384 00000100:00100000:3.0:1782756356.059544:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222656384 00000100:00100000:3.0:1782756356.059595:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1782756356.059603:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fbb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+19:3315:x1869355222656384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782756356.059692:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fbb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+19:3315:x1869355222656384:12345-0@lo:400:kworker.0 Request processed in 88us (8869us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756356.059699:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782756356.060021:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756356.060116:0:14912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222656640 00000100:00100000:2.0:1782756356.060121:0:14912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222656640 00000100:00100000:2.0:1782756356.060150:0:14912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782756356.060157:0:14912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3313:x1869355222656640:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1782756356.060188:0:14912:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 397 last 0 00000020:00000080:2.0:1782756356.060430:0:14912:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5e4fb0a8aa199ebb 00002000:00100000:2.0:1782756356.060450:0:14912:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9d3b427d7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1782756356.060454:0:14912:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1782756356.060457:0:14912:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1782756356.061791:0:14912:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782756356.061832:0:14912:0:(import.c:65:import_set_state_nolock()) ffff9d3b427d6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782756356.062445:0:14912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1869355222656640:12345-0@lo:8:kworker.0 Request processed in 2282us (2421us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756356.062458:0:14912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1782756356.062544:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c78e12680 x1869355222656640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782756381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1782756356.062564:0:3313:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1782756356.062575:0:3313:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1782756356.062581:0:3313:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1782756356.062593:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9d3b41d9d000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1782756356.062613:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1782756356.062621:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869355222656640:0@lo:8:kworker.0 00000004:00080000:1.0:1782756356.062642:0:14296:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1782756356.062733:0:14297:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1782756356.062760:0:14297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fb8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14297:1869355222657280:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1782756356.062808:0:14297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756356.062844:0:14297:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c49014300 going to sleep for 11 seconds 00000100:00100000:2.0:1782756356.062862:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222657152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782756356.062893:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756356.062927:0:14911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222657280 00000100:00100000:2.0:1782756356.062934:0:14911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222657280 00000100:00100000:2.0:1782756356.062991:0:14911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782756356.063002:0:14911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14297:x1869355222657280:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1782756356.063117:0:14296:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 397298040982ns, next at 0ns, rc = 0 00000100:00080000:3.0:1782756356.063626:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782756356.063861:0:14914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222657152 00000100:00100000:0.0:1782756356.063876:0:14914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222657152 00000100:00100000:0.0:1782756356.063960:0:14914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782756356.064040:0:14914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1869355222657152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782756356.064141:0:14914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782756356.064241:0:14914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1869355222657152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 207us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756356.064456:0:14914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1782756356.064611:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c80fbbb80 x1869355222657152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782756372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756356.064642:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222657152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782756356.064803:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756356.064925:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222657024 00000100:00100000:3.0:1782756356.064936:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222657024 00000100:00100000:3.0:1782756356.064999:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782756356.065011:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869355222657024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782756356.065357:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869355222657024:12345-0@lo:400:kworker.0 Request processed in 348us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756356.065365:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1782756356.065392:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:2.0:1782756356.068794:0:14911:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1782756356.068805:0:14911:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1782756356.068812:0:14911:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00010000:00080000:0.0:1782756356.070202:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d3c78e11500 x1869355222657024/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782756372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782756356.070228:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869355222657024:0@lo:400:kworker.0 00000100:00100000:0.0:1782756356.070287:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c7873c7-f262-4959-b911-d0a7cf42af86:3315:1869355222656384:0@lo:400:kworker.0 00002000:00010000:2.0:1782756356.085189:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782756356.085202:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199ec2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.085593:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1782756356.085599:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756356.085608:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199ec2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.085630:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199ec2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.085652:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199ec2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.085660:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199ec2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.085749:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782756356.085764:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782756356.085770:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199ec2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.085779:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d200 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:2.0:1782756356.085784:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199ec2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.085793:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199ec2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.085810:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199ec2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.085818:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199ec2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.085903:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756356.085911:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756356.085913:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782756356.086591:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782756356.086600:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eddd80a6/0x5e4fb0a8aa199ec9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.086611:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1782756356.086614:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756356.086619:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eddd80a6/0x5e4fb0a8aa199ec9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.086630:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eddd80a6/0x5e4fb0a8aa199ec9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.086639:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eddd80a6/0x5e4fb0a8aa199ec9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.086647:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eddd80a6/0x5e4fb0a8aa199ec9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.086666:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782756356.086845:0:14260:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782756356.086852:0:14260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eddd80a6/0x5e4fb0a8aa199ec9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756356.086860:0:14260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63de00 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:0.0:1782756356.086864:0:14260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eddd80a6/0x5e4fb0a8aa199ec9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756356.086873:0:14260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eddd80a6/0x5e4fb0a8aa199ec9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756356.086888:0:14260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eddd80a6/0x5e4fb0a8aa199ec9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756356.086896:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eddd80a6/0x5e4fb0a8aa199ec9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756356.086913:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756356.086915:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756356.086916:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782756356.087401:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782756356.087408:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa199ed0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.087417:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1782756356.087420:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756356.087424:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa199ed0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.087441:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa199ed0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.087449:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa199ed0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.087456:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa199ed0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.087483:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782756356.087493:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782756356.087497:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa199ed0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.087504:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d800 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:2.0:1782756356.087507:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa199ed0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.087515:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa199ed0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.087525:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa199ed0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.087532:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa199ed0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.087550:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756356.087552:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756356.087554:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782756356.088121:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782756356.088127:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019b02d84/0x5e4fb0a8aa199ed7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.088136:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1782756356.088139:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756356.088143:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019b02d84/0x5e4fb0a8aa199ed7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.088152:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019b02d84/0x5e4fb0a8aa199ed7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.088160:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019b02d84/0x5e4fb0a8aa199ed7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.088167:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019b02d84/0x5e4fb0a8aa199ed7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.088182:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782756356.088190:0:14260:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782756356.088193:0:14260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019b02d84/0x5e4fb0a8aa199ed7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.088211:0:14260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d000 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:2.0:1782756356.088214:0:14260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019b02d84/0x5e4fb0a8aa199ed7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.088312:0:14260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019b02d84/0x5e4fb0a8aa199ed7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.088324:0:14260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019b02d84/0x5e4fb0a8aa199ed7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.088331:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019b02d84/0x5e4fb0a8aa199ed7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.088345:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756356.088347:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756356.088348:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782756356.088963:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782756356.088971:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199ede lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.088981:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1782756356.088984:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756356.088989:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199ede lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.088999:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199ede lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.089014:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199ede lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.089022:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199ede lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.089037:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782756356.089050:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782756356.089055:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199ede lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.089062:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63c000 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:2.0:1782756356.089065:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199ede lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.089102:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199ede lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.089115:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199ede lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.089122:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199ede lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.089139:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756356.089146:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756356.089148:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782756356.090385:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782756356.090395:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bcdf720/0x5e4fb0a8aa199ee5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.090405:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1782756356.090409:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756356.090413:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bcdf720/0x5e4fb0a8aa199ee5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.090425:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bcdf720/0x5e4fb0a8aa199ee5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.090434:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bcdf720/0x5e4fb0a8aa199ee5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.090441:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009bcdf720/0x5e4fb0a8aa199ee5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.090473:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782756356.090506:0:14260:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782756356.090512:0:14260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009bcdf720/0x5e4fb0a8aa199ee5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.090520:0:14260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d400 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:1.0:1782756356.090524:0:14260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009bcdf720/0x5e4fb0a8aa199ee5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.090532:0:14260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009bcdf720/0x5e4fb0a8aa199ee5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.090559:0:14260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009bcdf720/0x5e4fb0a8aa199ee5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.090566:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bcdf720/0x5e4fb0a8aa199ee5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.090585:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756356.090587:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756356.090589:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782756356.090979:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782756356.090986:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd9796c2/0x5e4fb0a8aa199eec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.090994:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1782756356.090997:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756356.091001:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd9796c2/0x5e4fb0a8aa199eec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.091018:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd9796c2/0x5e4fb0a8aa199eec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.091027:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd9796c2/0x5e4fb0a8aa199eec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.091035:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd9796c2/0x5e4fb0a8aa199eec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.091059:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782756356.091482:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782756356.091490:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd9796c2/0x5e4fb0a8aa199eec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756356.091498:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63c800 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:0.0:1782756356.091501:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd9796c2/0x5e4fb0a8aa199eec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756356.091521:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd9796c2/0x5e4fb0a8aa199eec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756356.091533:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd9796c2/0x5e4fb0a8aa199eec lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756356.091539:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd9796c2/0x5e4fb0a8aa199eec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756356.091554:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756356.091556:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756356.091557:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782756356.091901:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782756356.091908:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcb085cc/0x5e4fb0a8aa199ef3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.091917:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1782756356.091921:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756356.091926:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcb085cc/0x5e4fb0a8aa199ef3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.091935:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcb085cc/0x5e4fb0a8aa199ef3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.091944:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcb085cc/0x5e4fb0a8aa199ef3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.091962:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcb085cc/0x5e4fb0a8aa199ef3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.091981:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1782756356.092673:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782756356.092758:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199efa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.092769:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1782756356.092771:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756356.092776:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199efa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.092785:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199efa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.092794:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199efa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.092800:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199efa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.092814:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1782756356.092824:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782756356.092828:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcb085cc/0x5e4fb0a8aa199ef3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.092910:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63ca00 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:2.0:1782756356.092914:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcb085cc/0x5e4fb0a8aa199ef3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.092922:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcb085cc/0x5e4fb0a8aa199ef3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.092937:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcb085cc/0x5e4fb0a8aa199ef3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.092945:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcb085cc/0x5e4fb0a8aa199ef3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.092959:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782756356.092962:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199efa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.092962:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756356.092969:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d200 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:2.0:1782756356.092972:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199efa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.092979:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199efa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.092989:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199efa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.093004:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007a620cf/0x5e4fb0a8aa199efa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.093018:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756356.093020:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756356.093022:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782756356.093642:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782756356.093650:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d4c92f8/0x5e4fb0a8aa199f01 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.093660:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1782756356.093664:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756356.093669:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d4c92f8/0x5e4fb0a8aa199f01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.093748:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d4c92f8/0x5e4fb0a8aa199f01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.093759:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d4c92f8/0x5e4fb0a8aa199f01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.093767:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d4c92f8/0x5e4fb0a8aa199f01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.093829:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1782756356.094383:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782756356.094397:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b6c8575/0x5e4fb0a8aa199f08 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.094408:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1782756356.094411:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756356.094416:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b6c8575/0x5e4fb0a8aa199f08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.094426:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b6c8575/0x5e4fb0a8aa199f08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.094434:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b6c8575/0x5e4fb0a8aa199f08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.094442:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b6c8575/0x5e4fb0a8aa199f08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.095033:0:14260:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782756356.095041:0:14260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d4c92f8/0x5e4fb0a8aa199f01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.095051:0:14260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63c600 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:1.0:1782756356.095055:0:14260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d4c92f8/0x5e4fb0a8aa199f01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.095064:0:14260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d4c92f8/0x5e4fb0a8aa199f01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.095098:0:14260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d4c92f8/0x5e4fb0a8aa199f01 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.095106:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d4c92f8/0x5e4fb0a8aa199f01 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.095139:0:14260:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782756356.095143:0:14260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b6c8575/0x5e4fb0a8aa199f08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.095148:0:14260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63dc00 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:1.0:1782756356.095151:0:14260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b6c8575/0x5e4fb0a8aa199f08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.095158:0:14260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b6c8575/0x5e4fb0a8aa199f08 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.095166:0:14260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b6c8575/0x5e4fb0a8aa199f08 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.095173:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756356.095174:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756356.095176:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782756356.095189:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1782756356.095357:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756356.095381:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1782756356.095389:0:14911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b6c8575/0x5e4fb0a8aa199f08 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782756356.096175:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782756356.096184:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199f0f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.096194:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1782756356.096198:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756356.096208:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199f0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.096349:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199f0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.096361:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199f0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.096368:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199f0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.096388:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1782756356.096963:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782756356.096969:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019b02d84/0x5e4fb0a8aa199f16 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.096978:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1782756356.096981:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756356.096986:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019b02d84/0x5e4fb0a8aa199f16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.096995:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019b02d84/0x5e4fb0a8aa199f16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.097004:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019b02d84/0x5e4fb0a8aa199f16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.097020:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019b02d84/0x5e4fb0a8aa199f16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.097039:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1782756356.097051:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782756356.097056:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199f0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.097064:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63c000 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:2.0:1782756356.097068:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199f0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.097096:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199f0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.097112:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199f0f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.097120:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c46886f8/0x5e4fb0a8aa199f0f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.097137:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782756356.097139:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019b02d84/0x5e4fb0a8aa199f16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.097157:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d000 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:2.0:1782756356.097161:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019b02d84/0x5e4fb0a8aa199f16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.097169:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019b02d84/0x5e4fb0a8aa199f16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.097180:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019b02d84/0x5e4fb0a8aa199f16 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.097186:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019b02d84/0x5e4fb0a8aa199f16 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.097200:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756356.097202:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756356.097204:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756356.097884:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782756356.098230:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782756356.098481:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa199f1d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.098496:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1782756356.098500:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756356.098505:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa199f1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.098516:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa199f1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.098532:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa199f1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.098540:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa199f1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.098667:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782756356.098935:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782756356.098941:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa199f1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.098957:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d800 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:2.0:1782756356.098962:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa199f1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.098971:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa199f1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.098994:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa199f1d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.099001:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9209775/0x5e4fb0a8aa199f1d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.099028:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756356.099030:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756356.099038:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782756356.100131:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782756356.100142:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004da6502e/0x5e4fb0a8aa199f24 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.100157:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=397s v=(0 0) 00010000:00010000:1.0:1782756356.100160:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756356.100174:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004da6502e/0x5e4fb0a8aa199f24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.100193:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004da6502e/0x5e4fb0a8aa199f24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.100209:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004da6502e/0x5e4fb0a8aa199f24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.100228:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004da6502e/0x5e4fb0a8aa199f24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.100569:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782756356.100765:0:14260:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756356.100773:0:14260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004da6502e/0x5e4fb0a8aa199f24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.100788:0:14260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4600 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756356.100792:0:14260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004da6502e/0x5e4fb0a8aa199f24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.100801:0:14260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004da6502e/0x5e4fb0a8aa199f24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.100828:0:14260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004da6502e/0x5e4fb0a8aa199f24 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.100923:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004da6502e/0x5e4fb0a8aa199f24 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.100970:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756356.100972:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756356.100974:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782756356.102011:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782756356.102023:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000665debce/0x5e4fb0a8aa199f2b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.102036:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=397s v=(0 0) 00010000:00010000:1.0:1782756356.102040:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756356.102046:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000665debce/0x5e4fb0a8aa199f2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.102058:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000665debce/0x5e4fb0a8aa199f2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.102068:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000665debce/0x5e4fb0a8aa199f2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.102337:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000665debce/0x5e4fb0a8aa199f2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.102369:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782756356.102925:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782756356.102935:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000665debce/0x5e4fb0a8aa199f2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.102944:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5800 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:2.0:1782756356.102949:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000665debce/0x5e4fb0a8aa199f2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.102958:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000665debce/0x5e4fb0a8aa199f2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.102975:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000665debce/0x5e4fb0a8aa199f2b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.102982:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000665debce/0x5e4fb0a8aa199f2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.103003:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756356.103004:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756356.103006:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782756356.103534:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782756356.103542:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a56dca5e/0x5e4fb0a8aa199f32 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.103553:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=397s v=(0 0) 00010000:00010000:1.0:1782756356.103556:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756356.103560:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a56dca5e/0x5e4fb0a8aa199f32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.103570:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a56dca5e/0x5e4fb0a8aa199f32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.103577:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a56dca5e/0x5e4fb0a8aa199f32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.103584:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a56dca5e/0x5e4fb0a8aa199f32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.103606:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782756356.103756:0:14260:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756356.103763:0:14260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a56dca5e/0x5e4fb0a8aa199f32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.103771:0:14260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5c00 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756356.103774:0:14260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a56dca5e/0x5e4fb0a8aa199f32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.103793:0:14260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a56dca5e/0x5e4fb0a8aa199f32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.103807:0:14260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a56dca5e/0x5e4fb0a8aa199f32 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.103814:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a56dca5e/0x5e4fb0a8aa199f32 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.104331:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756356.104335:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756356.104337:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782756356.105567:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782756356.105579:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fe33af4/0x5e4fb0a8aa199f39 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.105600:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=397s v=(0 0) 00010000:00010000:1.0:1782756356.105604:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756356.105609:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fe33af4/0x5e4fb0a8aa199f39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.105622:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fe33af4/0x5e4fb0a8aa199f39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.105632:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fe33af4/0x5e4fb0a8aa199f39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.105640:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fe33af4/0x5e4fb0a8aa199f39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.105665:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782756356.105795:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756356.105801:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fe33af4/0x5e4fb0a8aa199f39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.105809:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5600 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756356.105813:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fe33af4/0x5e4fb0a8aa199f39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.105822:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fe33af4/0x5e4fb0a8aa199f39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.105850:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fe33af4/0x5e4fb0a8aa199f39 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.105873:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fe33af4/0x5e4fb0a8aa199f39 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.105890:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756356.105892:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756356.105894:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782756356.107134:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782756356.107145:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070235c92/0x5e4fb0a8aa199f40 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.107157:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=397s v=(0 0) 00010000:00010000:1.0:1782756356.107161:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756356.107166:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070235c92/0x5e4fb0a8aa199f40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.107177:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070235c92/0x5e4fb0a8aa199f40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.107198:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070235c92/0x5e4fb0a8aa199f40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.107206:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070235c92/0x5e4fb0a8aa199f40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.107491:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782756356.107957:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782756356.107964:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199f47 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.107974:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=397s v=(0 0) 00010000:00010000:1.0:1782756356.107978:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756356.107982:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199f47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.107992:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199f47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.108001:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199f47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.108008:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199f47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.108194:0:14260:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782756356.108202:0:14260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070235c92/0x5e4fb0a8aa199f40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.108211:0:14260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4200 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756356.108226:0:14260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070235c92/0x5e4fb0a8aa199f40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.108235:0:14260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070235c92/0x5e4fb0a8aa199f40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.108261:0:14260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070235c92/0x5e4fb0a8aa199f40 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.108269:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070235c92/0x5e4fb0a8aa199f40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.108287:0:14260:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756356.108291:0:14260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199f47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.108304:0:14260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4a00 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756356.108307:0:14260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199f47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.108315:0:14260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199f47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.108326:0:14260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199f47 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.108333:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756356.108335:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756356.108337:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756356.108527:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1782756356.108533:0:14911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042819675/0x5e4fb0a8aa199f47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782756356.109052:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782756356.109060:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3516fe2/0x5e4fb0a8aa199f4e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.109070:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=397s v=(0 0) 00010000:00010000:1.0:1782756356.109094:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756356.109098:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3516fe2/0x5e4fb0a8aa199f4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.109110:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3516fe2/0x5e4fb0a8aa199f4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.109119:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3516fe2/0x5e4fb0a8aa199f4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.109127:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3516fe2/0x5e4fb0a8aa199f4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.111762:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756356.111782:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3516fe2/0x5e4fb0a8aa199f4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.111797:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5000 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756356.111803:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3516fe2/0x5e4fb0a8aa199f4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.111815:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3516fe2/0x5e4fb0a8aa199f4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.111848:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3516fe2/0x5e4fb0a8aa199f4e lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.111867:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756356.111869:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756356.111871:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756356.112744:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1782756356.112755:0:14911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3516fe2/0x5e4fb0a8aa199f4e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756356.113001:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782756356.114210:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782756356.114223:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b9cfd33/0x5e4fb0a8aa199f55 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.114239:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=397s v=(0 0) 00010000:00010000:1.0:1782756356.114244:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756356.114251:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b9cfd33/0x5e4fb0a8aa199f55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.114276:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b9cfd33/0x5e4fb0a8aa199f55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.114288:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b9cfd33/0x5e4fb0a8aa199f55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.114295:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b9cfd33/0x5e4fb0a8aa199f55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.114522:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782756356.114549:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756356.114557:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b9cfd33/0x5e4fb0a8aa199f55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.114566:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5200 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756356.114572:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b9cfd33/0x5e4fb0a8aa199f55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.114583:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b9cfd33/0x5e4fb0a8aa199f55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.114604:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b9cfd33/0x5e4fb0a8aa199f55 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.114611:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b9cfd33/0x5e4fb0a8aa199f55 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.114632:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756356.114634:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756356.114636:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782756356.115269:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782756356.115277:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058f1ada4/0x5e4fb0a8aa199f5c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.115288:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=397s v=(0 0) 00010000:00010000:1.0:1782756356.115291:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756356.115314:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058f1ada4/0x5e4fb0a8aa199f5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.115503:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058f1ada4/0x5e4fb0a8aa199f5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.115517:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058f1ada4/0x5e4fb0a8aa199f5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.115525:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058f1ada4/0x5e4fb0a8aa199f5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.115552:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782756356.115584:0:14260:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756356.115591:0:14260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058f1ada4/0x5e4fb0a8aa199f5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.115608:0:14260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5e00 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756356.115612:0:14260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058f1ada4/0x5e4fb0a8aa199f5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.115620:0:14260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058f1ada4/0x5e4fb0a8aa199f5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.115633:0:14260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058f1ada4/0x5e4fb0a8aa199f5c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.115640:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058f1ada4/0x5e4fb0a8aa199f5c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.115657:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756356.115658:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756356.115660:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782756356.116274:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782756356.116283:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa199f63 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.116293:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=397s v=(0 0) 00010000:00010000:1.0:1782756356.116296:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756356.116310:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa199f63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.116320:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa199f63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.116502:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa199f63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.116521:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa199f63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.116537:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782756356.117188:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782756356.117195:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0e1c17f/0x5e4fb0a8aa199f6a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.117204:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=397s v=(0 0) 00010000:00010000:1.0:1782756356.117207:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756356.117211:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e1c17f/0x5e4fb0a8aa199f6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.117221:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0e1c17f/0x5e4fb0a8aa199f6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.117229:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0e1c17f/0x5e4fb0a8aa199f6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.117236:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e1c17f/0x5e4fb0a8aa199f6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.117253:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1782756356.117333:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782756356.117339:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa199f63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.117348:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4c00 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756356.117352:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa199f63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.117360:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa199f63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.117383:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa199f63 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.117390:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa199f63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.117408:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756356.117411:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0e1c17f/0x5e4fb0a8aa199f6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.117418:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41496400 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756356.117421:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0e1c17f/0x5e4fb0a8aa199f6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.117429:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0e1c17f/0x5e4fb0a8aa199f6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.117438:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0e1c17f/0x5e4fb0a8aa199f6a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.117445:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0e1c17f/0x5e4fb0a8aa199f6a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.117458:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756356.117459:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756356.117478:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756356.117484:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782756356.117845:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782756356.117852:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa199f71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.117866:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=397s v=(0 0) 00010000:00010000:1.0:1782756356.117869:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756356.117874:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa199f71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.117884:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa199f71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.117892:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa199f71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.117900:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa199f71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.117925:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782756356.118028:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756356.118033:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa199f71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.118040:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41496600 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756356.118044:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa199f71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.118052:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa199f71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.118064:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa199f71 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.118094:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756356.118096:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756356.118098:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782756356.118494:0:14911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa199f71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782756356.119529:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782756356.119538:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e13bf38/0x5e4fb0a8aa199f78 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.119550:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=397s v=(0 0) 00010000:00010000:1.0:1782756356.119554:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756356.119559:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e13bf38/0x5e4fb0a8aa199f78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.119582:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e13bf38/0x5e4fb0a8aa199f78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.119592:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e13bf38/0x5e4fb0a8aa199f78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.119599:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e13bf38/0x5e4fb0a8aa199f78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.119615:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782756356.120224:0:14911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782756356.120232:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d173de0e/0x5e4fb0a8aa199f7f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.120240:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=397s v=(0 0) 00010000:00010000:1.0:1782756356.120243:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756356.120246:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d173de0e/0x5e4fb0a8aa199f7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.120255:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d173de0e/0x5e4fb0a8aa199f7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.120780:0:14260:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756356.120789:0:14260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e13bf38/0x5e4fb0a8aa199f78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.120799:0:14260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41497000 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756356.120804:0:14260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e13bf38/0x5e4fb0a8aa199f78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.120815:0:14260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e13bf38/0x5e4fb0a8aa199f78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.120827:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d173de0e/0x5e4fb0a8aa199f7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.120849:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d173de0e/0x5e4fb0a8aa199f7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756356.120869:0:14911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782756356.120922:0:14260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e13bf38/0x5e4fb0a8aa199f78 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.120932:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e13bf38/0x5e4fb0a8aa199f78 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.120954:0:14260:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756356.120957:0:14260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d173de0e/0x5e4fb0a8aa199f7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.120963:0:14260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41497400 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756356.120966:0:14260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d173de0e/0x5e4fb0a8aa199f7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.120974:0:14260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d173de0e/0x5e4fb0a8aa199f7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.120984:0:14260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d173de0e/0x5e4fb0a8aa199f7f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.120991:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d173de0e/0x5e4fb0a8aa199f7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756356.121002:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756356.121004:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756356.121012:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756356.121019:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1782756356.121214:0:14911:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:1.0:1782756356.121820:0:14911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14297:x1869355222657280:12345-0@lo:5:osp-pre-1-0.0 Request processed in 58816us (59007us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756356.121837:0:14911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782756356.121937:0:14297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fb8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14297:1869355222657280:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1782756356.121955:0:14297:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1782756356.122008:0:14297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fb8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14297:1869355222657408:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1782756356.122051:0:14297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756356.122128:0:14297:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c78a50540 going to sleep for 11 seconds 00000100:00100000:2.0:1782756356.122148:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222657408 00000100:00100000:2.0:1782756356.122153:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222657408 00000100:00100000:2.0:1782756356.122211:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782756356.122222:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14297:x1869355222657408:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1782756356.122278:0:14910:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1782756356.130030:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14297:x1869355222657408:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7802us (7970us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1782756356.130045:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782756356.130251:0:14297:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fb8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14297:1869355222657408:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1782756356.130269:0:14297:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1782756356.175455:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756357.090194:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756357.090324:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210086400 00000100:00100000:3.0:1782756357.090338:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210086400 00000100:00100000:3.0:1782756357.090453:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 73 00000100:00100000:3.0:1782756357.090465:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fbb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2354:x1869355210086400:12345-192.168.204.25@tcp:250:mount.lustre.0 00010000:00080000:3.0:1782756357.090503:0:14267:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from a70182dd-4d00-4e89-9377-2e7b41557e6b@192.168.204.25@tcp t0 exp 0000000000000000 cur 398 last 0 00000020:00000080:3.0:1782756357.090543:0:14267:0:(genops.c:1406:class_connect()) connect: client a70182dd-4d00-4e89-9377-2e7b41557e6b, cookie 0x5e4fb0a8aa199f86 00000100:00080000:3.0:1782756357.090735:0:14267:0:(import.c:65:import_set_state_nolock()) ffff9d3c7f2d0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782756357.090840:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fbb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a70182dd-4d00-4e89-9377-2e7b41557e6b+5:2354:x1869355210086400:12345-192.168.204.25@tcp:250:mount.lustre.0 Request processed in 375us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756357.090850:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 73 00000100:00100000:1.0:1782756357.098350:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756357.098441:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210086528 00000100:00100000:2.0:1782756357.098465:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210086528 00000100:00100000:2.0:1782756357.098542:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 74 00000100:00100000:2.0:1782756357.098554:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c47ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a70182dd-4d00-4e89-9377-2e7b41557e6b+5:13703:x1869355210086528:12345-192.168.204.25@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782756357.098579:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756357.098605:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4a63d200/0x5e4fb0a8aa199f8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce25a expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756357.098642:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4a63d200/0x5e4fb0a8aa199f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce25a expref: 6 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756357.098655:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4a63d200/0x5e4fb0a8aa199f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce25a expref: 6 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756357.098666:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63d200, rc 0) 00000100:00100000:2.0:1782756357.098744:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c47ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a70182dd-4d00-4e89-9377-2e7b41557e6b+6:13703:x1869355210086528:12345-192.168.204.25@tcp:101:mount.lustre.0 Request processed in 192us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756357.098752:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 74 00000100:00100000:0.0:1782756357.103206:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756357.103418:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210086656 00000100:00100000:3.0:1782756357.103431:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210086656 00000100:00100000:3.0:1782756357.103521:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 75 00000100:00100000:3.0:1782756357.103533:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c47ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a70182dd-4d00-4e89-9377-2e7b41557e6b+6:13703:x1869355210086656:12345-192.168.204.25@tcp:501:mount.lustre.0 00000100:00100000:3.0:1782756357.104037:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c47ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a70182dd-4d00-4e89-9377-2e7b41557e6b+6:13703:x1869355210086656:12345-192.168.204.25@tcp:501:mount.lustre.0 Request processed in 503us (841us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782756357.104048:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 75 00000100:00100000:1.0:1782756357.111983:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756357.112334:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210086784 00000100:00100000:2.0:1782756357.112365:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210086784 00000100:00100000:2.0:1782756357.112509:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 76 00000100:00100000:2.0:1782756357.112522:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c47eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a70182dd-4d00-4e89-9377-2e7b41557e6b+6:13703:x1869355210086784:12345-192.168.204.25@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782756357.112547:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756357.112570:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4a63ca00/0x5e4fb0a8aa199f94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce261 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756357.112612:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4a63ca00/0x5e4fb0a8aa199f94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce261 expref: 7 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756357.112662:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4a63ca00/0x5e4fb0a8aa199f94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce261 expref: 7 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756357.112676:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63ca00, rc 0) 00000100:00100000:2.0:1782756357.112759:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c47eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a70182dd-4d00-4e89-9377-2e7b41557e6b+7:13703:x1869355210086784:12345-192.168.204.25@tcp:101:mount.lustre.0 Request processed in 240us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756357.112766:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 76 00000100:00100000:1.0:1782756357.115241:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756357.115417:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210086912 00000100:00100000:3.0:1782756357.115430:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210086912 00000100:00100000:3.0:1782756357.115567:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 77 00000100:00100000:3.0:1782756357.115578:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c47ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a70182dd-4d00-4e89-9377-2e7b41557e6b+7:13703:x1869355210086912:12345-192.168.204.25@tcp:501:mount.lustre.0 00000100:00100000:3.0:1782756357.116151:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c47ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a70182dd-4d00-4e89-9377-2e7b41557e6b+8:13703:x1869355210086912:12345-192.168.204.25@tcp:501:mount.lustre.0 Request processed in 571us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756357.116174:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 77 00000100:00100000:0.0:1782756357.118925:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756357.119324:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210087040 00000100:00100000:2.0:1782756357.119337:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210087040 00000100:00100000:2.0:1782756357.119476:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 78 00000100:00100000:2.0:1782756357.119490:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c47ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a70182dd-4d00-4e89-9377-2e7b41557e6b+8:13703:x1869355210087040:12345-192.168.204.25@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782756357.119824:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c47ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a70182dd-4d00-4e89-9377-2e7b41557e6b+8:13703:x1869355210087040:12345-192.168.204.25@tcp:503:mount.lustre.0 Request processed in 335us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756357.119834:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 78 00000100:00100000:1.0:1782756357.122895:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756357.122993:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210087168 00000100:00100000:3.0:1782756357.123004:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210087168 00000100:00100000:3.0:1782756357.123068:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 79 00000100:00100000:3.0:1782756357.123228:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c47eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a70182dd-4d00-4e89-9377-2e7b41557e6b+8:13721:x1869355210087168:12345-192.168.204.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782756357.123695:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c47eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a70182dd-4d00-4e89-9377-2e7b41557e6b+8:13721:x1869355210087168:12345-192.168.204.25@tcp:502:llog_process_th.0 Request processed in 470us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756357.123704:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 79 00000100:00100000:1.0:1782756357.138659:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756357.139646:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210087296 00000100:00100000:2.0:1782756357.139662:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210087296 00000100:00100000:2.0:1782756357.139755:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 80 00000100:00100000:2.0:1782756357.139768:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76ac9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a70182dd-4d00-4e89-9377-2e7b41557e6b+8:13721:x1869355210087296:12345-192.168.204.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782756357.140232:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76ac9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a70182dd-4d00-4e89-9377-2e7b41557e6b+8:13721:x1869355210087296:12345-192.168.204.25@tcp:502:llog_process_th.0 Request processed in 465us (1585us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756357.140243:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 80 00000100:00100000:0.0:1782756357.144176:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756357.144281:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210087424 00000100:00100000:3.0:1782756357.144296:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210087424 00000100:00100000:3.0:1782756357.144428:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 81 00000100:00100000:3.0:1782756357.144441:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76ac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a70182dd-4d00-4e89-9377-2e7b41557e6b+8:13703:x1869355210087424:12345-192.168.204.25@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782756357.144475:0:14267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756357.144498:0:14267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c40031c00/0x5e4fb0a8aa199f9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce28b expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756357.144537:0:14267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c40031c00/0x5e4fb0a8aa199f9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce28b expref: 9 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756357.144550:0:14267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c40031c00/0x5e4fb0a8aa199f9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce28b expref: 9 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756357.144561:0:14267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c40031c00, rc 0) 00000100:00100000:3.0:1782756357.144639:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76ac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a70182dd-4d00-4e89-9377-2e7b41557e6b+9:13703:x1869355210087424:12345-192.168.204.25@tcp:101:mount.lustre.0 Request processed in 200us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756357.144652:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 81 00000100:00100000:1.0:1782756357.150361:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756357.150628:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210087552 00000100:00100000:3.0:1782756357.150641:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210087552 00000100:00100000:3.0:1782756357.150715:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 82 00000100:00100000:3.0:1782756357.150740:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76ac8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a70182dd-4d00-4e89-9377-2e7b41557e6b+9:13703:x1869355210087552:12345-192.168.204.25@tcp:256:mount.lustre.0 20000000:01000000:3.0:1782756357.150778:0:14266:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1782756357.150808:0:14266:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1782756357.150812:0:14266:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1782756357.150816:0:14266:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1782756357.150818:0:14266:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1782756357.153501:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76ac8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a70182dd-4d00-4e89-9377-2e7b41557e6b+9:13703:x1869355210087552:12345-192.168.204.25@tcp:256:mount.lustre.0 Request processed in 2759us (3137us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756357.153523:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 82 00000100:00100000:0.0:1782756357.158739:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756357.158938:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210087680 00000100:00100000:3.0:1782756357.158953:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210087680 00000100:00100000:3.0:1782756357.159027:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 83 00000100:00100000:3.0:1782756357.159041:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76ac9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a70182dd-4d00-4e89-9377-2e7b41557e6b+9:13703:x1869355210087680:12345-192.168.204.25@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782756357.159065:0:14267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756357.159132:0:14267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa199fa2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce292 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756357.159169:0:14267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa199fa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce292 expref: 10 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756357.159182:0:14267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa199fa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce292 expref: 10 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756357.159192:0:14267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c40030c00, rc 0) 00000100:00100000:3.0:1782756357.159439:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76ac9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a70182dd-4d00-4e89-9377-2e7b41557e6b+10:13703:x1869355210087680:12345-192.168.204.25@tcp:101:mount.lustre.0 Request processed in 400us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756357.159476:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 83 00000100:00100000:2.0:1782756357.164261:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756357.164408:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210087808 00000100:00100000:3.0:1782756357.164422:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210087808 00000100:00100000:3.0:1782756357.164505:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 84 00000100:00100000:3.0:1782756357.164519:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76acac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a70182dd-4d00-4e89-9377-2e7b41557e6b+10:13703:x1869355210087808:12345-192.168.204.25@tcp:501:mount.lustre.0 00000100:00100000:3.0:1782756357.165199:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76acac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a70182dd-4d00-4e89-9377-2e7b41557e6b+10:13703:x1869355210087808:12345-192.168.204.25@tcp:501:mount.lustre.0 Request processed in 680us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756357.165210:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 84 00000100:00100000:2.0:1782756357.167577:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756357.167694:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210087936 00000100:00100000:0.0:1782756357.167707:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210087936 00000100:00100000:0.0:1782756357.167777:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 85 00000100:00100000:0.0:1782756357.167788:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76aca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a70182dd-4d00-4e89-9377-2e7b41557e6b+10:13703:x1869355210087936:12345-192.168.204.25@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782756357.168131:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76aca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a70182dd-4d00-4e89-9377-2e7b41557e6b+10:13703:x1869355210087936:12345-192.168.204.25@tcp:503:mount.lustre.0 Request processed in 342us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756357.168152:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 85 00000100:00100000:0.0:1782756357.170914:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756357.171678:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210088064 00000100:00100000:3.0:1782756357.171693:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210088064 00000100:00100000:3.0:1782756357.171772:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 86 00000100:00100000:3.0:1782756357.171784:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76ac9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a70182dd-4d00-4e89-9377-2e7b41557e6b+10:13725:x1869355210088064:12345-192.168.204.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782756357.174005:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76ac9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a70182dd-4d00-4e89-9377-2e7b41557e6b+10:13725:x1869355210088064:12345-192.168.204.25@tcp:502:llog_process_th.0 Request processed in 2199us (3080us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756357.174024:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 86 00000100:00100000:1.0:1782756357.180751:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756357.180872:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210088192 00000100:00100000:2.0:1782756357.180886:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210088192 00000100:00100000:2.0:1782756357.180964:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 87 00000100:00100000:2.0:1782756357.180976:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76ac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a70182dd-4d00-4e89-9377-2e7b41557e6b+10:13725:x1869355210088192:12345-192.168.204.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782756357.181366:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76ac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a70182dd-4d00-4e89-9377-2e7b41557e6b+10:13725:x1869355210088192:12345-192.168.204.25@tcp:502:llog_process_th.0 Request processed in 390us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756357.181376:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 87 00000100:00100000:2.0:1782756357.188333:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756357.189719:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210088320 00000100:00100000:3.0:1782756357.189749:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210088320 00000100:00100000:3.0:1782756357.189839:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 4 00000100:00100000:3.0:1782756357.189849:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2354:x1869355210088320:12345-192.168.204.25@tcp:38:mount.lustre.0 00010000:00080000:3.0:1782756357.189891:0:14273:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 7f2479af-f49e-47f8-ab4c-80d5e6645c7e@192.168.204.25@tcp t0 exp 0000000000000000 cur 398 last 0 00000020:00000080:3.0:1782756357.189953:0:14273:0:(genops.c:1406:class_connect()) connect: client 7f2479af-f49e-47f8-ab4c-80d5e6645c7e, cookie 0x5e4fb0a8aa199fa9 00000004:00100000:3.0:1782756357.189995:0:14273:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1782756357.190002:0:14273:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1782756357.196898:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782756357.243241:0:14273:0:(import.c:65:import_set_state_nolock()) ffff9d3c7f2d5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782756357.243447:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+6:2354:x1869355210088320:12345-192.168.204.25@tcp:38:mount.lustre.0 Request processed in 53588us (55128us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756357.243461:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 4 00000100:00100000:1.0:1782756357.254505:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756357.254543:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756357.254629:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210088576 00000100:00100000:3.0:1782756357.254638:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210088576 00000100:00100000:3.0:1782756357.254709:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210088448 00000100:00100000:3.0:1782756357.254712:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210088448 00000100:00100000:3.0:1782756357.254735:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5 00000100:00100000:3.0:1782756357.254744:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+7:13703:x1869355210088576:12345-192.168.204.25@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782756357.254788:0:14274:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1782756357.254863:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+7:13703:x1869355210088576:12345-192.168.204.25@tcp:41:mount.lustre.0 Request processed in 119us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756357.254871:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5 00000100:00100000:3.0:1782756357.254888:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6 00000100:00100000:3.0:1782756357.254894:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+6:0:x1869355210088448:12345-192.168.204.25@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782756357.254905:0:14274:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1782756357.254929:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+6:0:x1869355210088448:12345-192.168.204.25@tcp:41:mount.lustre.0 Request processed in 35us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756357.254934:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6 00000100:00080000:2.0:1782756357.255277:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782756357.257465:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756357.257611:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210088704 00000100:00100000:3.0:1782756357.257623:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210088704 00000100:00100000:3.0:1782756357.257695:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7 00000100:00100000:3.0:1782756357.257708:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+6:13703:x1869355210088704:12345-192.168.204.25@tcp:40:mount.lustre.0 00000100:00100000:3.0:1782756357.257881:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+6:13703:x1869355210088704:12345-192.168.204.25@tcp:40:mount.lustre.0 Request processed in 175us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756357.257911:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7 00000100:00100000:3.0:1782756357.261972:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756357.262135:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756357.262241:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210089088 00000100:00100000:0.0:1782756357.262253:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210089088 00000100:00100000:0.0:1782756357.262404:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 0 00000100:00100000:0.0:1782756357.262416:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+6:13703:x1869355210089088:12345-192.168.204.25@tcp:33:mount.lustre.0 00000100:00100000:1.0:1782756357.262607:0:14911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210088832 00000100:00100000:1.0:1782756357.262611:0:14911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210088832 00000100:00100000:1.0:1782756357.262643:0:14911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9 00000100:00100000:1.0:1782756357.262650:0:14911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1869355210088832:12345-192.168.204.25@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782756357.262682:0:14911:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 7f2479af-f49e-47f8-ab4c-80d5e6645c7e@192.168.204.25@tcp t0 exp 0000000000000000 cur 398 last 0 00000020:00000080:1.0:1782756357.262966:0:14911:0:(genops.c:1406:class_connect()) connect: client 7f2479af-f49e-47f8-ab4c-80d5e6645c7e, cookie 0x5e4fb0a8aa199fb0 00002000:00100000:1.0:1782756357.263058:0:14911:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7f2479af-f49e-47f8-ab4c-80d5e6645c7e/ffff9d3b421c3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782756357.263138:0:14911:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1782756357.264161:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756357.264254:0:14910:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1782756357.264266:0:14910:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1782756357.264722:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210088960 00000100:00100000:3.0:1782756357.264732:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210088960 00000004:00080000:3.0:1782756357.264781:0:14275:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2266us 00000100:00100000:0.0:1782756357.264966:0:16051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 10 00000100:00100000:0.0:1782756357.264976:0:16051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2354:x1869355210088960:12345-192.168.204.25@tcp:8:mount.lustre.0 00010000:00080000:0.0:1782756357.265094:0:16051:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 7f2479af-f49e-47f8-ab4c-80d5e6645c7e@192.168.204.25@tcp t0 exp 0000000000000000 cur 398 last 0 00000020:00000080:0.0:1782756357.265131:0:16051:0:(genops.c:1406:class_connect()) connect: client 7f2479af-f49e-47f8-ab4c-80d5e6645c7e, cookie 0x5e4fb0a8aa199fb7 00002000:00100000:0.0:1782756357.265144:0:16051:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7f2479af-f49e-47f8-ab4c-80d5e6645c7e/ffff9d3c470a8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782756357.265157:0:16051:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782756357.266113:0:16051:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782756357.266167:0:16051:0:(import.c:65:import_set_state_nolock()) ffff9d3c470a9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782756357.266405:0:16051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+6:2354:x1869355210088960:12345-192.168.204.25@tcp:8:mount.lustre.0 Request processed in 1427us (2248us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756357.266417:0:16051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 10 00002000:00080000:1.0:1782756357.266545:0:14911:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782756357.266565:0:14911:0:(import.c:65:import_set_state_nolock()) ffff9d3b421c5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782756357.266594:0:14911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+6:2354:x1869355210088832:12345-192.168.204.25@tcp:8:mount.lustre.0 Request processed in 3944us (4459us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756357.266602:0:14911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9 00000004:00200000:0.0:1782756357.285196:0:14275:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1782756357.285429:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+6:13703:x1869355210089088:12345-192.168.204.25@tcp:33:mount.lustre.0 Request processed in 23005us (23463us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756357.285452:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 0 00000100:00100000:0.0:1782756357.409814:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756357.409946:0:15590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210089216 00000100:00100000:1.0:1782756357.409960:0:15590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210089216 00000100:00100000:1.0:1782756357.410126:0:15590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8 00000100:00100000:1.0:1782756357.410139:0:15590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+6:13746:x1869355210089216:12345-192.168.204.25@tcp:101:mkdir.0 00010000:00010000:1.0:1782756357.410166:0:15590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756357.410210:0:15590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa199fbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce2bc expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756357.410302:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa199fc5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756357.410318:0:15590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa199fc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756357.410335:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa199fc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756357.410658:0:15590:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782756357.410663:0:15590:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1782756357.410783:0:15590:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa199fc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756357.410834:0:15590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa199fbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce2bc expref: 8 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756357.410860:0:15590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa199fc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce2bc expref: 7 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756357.410870:0:15590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c49e15f00) 00010000:00010000:1.0:1782756357.410873:0:15590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782756357.410878:0:15590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41497400, rc 0) 00000100:00100000:1.0:1782756357.410973:0:15590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+7:13746:x1869355210089216:12345-192.168.204.25@tcp:101:mkdir.0 Request processed in 831us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756357.410982:0:15590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8 00010000:00010000:3.0:1782756358.220499:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756358.604473:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782756358.605132:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222657536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782756358.605212:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756358.605521:0:14915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222657536 00000100:00100000:3.0:1782756358.605530:0:14915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222657536 00000100:00100000:3.0:1782756358.605631:0:14915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782756358.605641:0:14915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222657536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782756358.605666:0:14915:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782756358.605772:0:14915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222657536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756358.605779:0:14915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1782756358.606213:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782756358.606532:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222657536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782756359.181183:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756359.184256:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210089344 00000100:00100000:0.0:1782756359.184379:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210089344 00000100:00100000:0.0:1782756359.184598:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9 00000100:00100000:0.0:1782756359.184611:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+7:13798:x1869355210089344:12345-192.168.204.25@tcp:41:lfs.0 00000004:00000024:0.0:1782756359.184662:0:14273:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1782756359.184766:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+7:13798:x1869355210089344:12345-192.168.204.25@tcp:41:lfs.0 Request processed in 158us (3591us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756359.184773:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9 00000100:00080000:2.0:1782756359.185375:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782756359.188463:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756359.188520:0:14915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210089472 00000100:00100000:3.0:1782756359.188530:0:14915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210089472 00000100:00100000:3.0:1782756359.188679:0:14915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5 00000100:00100000:3.0:1782756359.188691:0:14915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+6:13798:x1869355210089472:12345-192.168.204.25@tcp:13:lfs.0 00002000:00000024:3.0:1782756359.188732:0:14915:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782756359.188825:0:14915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+6:13798:x1869355210089472:12345-192.168.204.25@tcp:13:lfs.0 Request processed in 136us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756359.188833:0:14915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5 00000100:00080000:2.0:1782756359.188956:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782756359.191011:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756359.191108:0:14915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210089600 00000100:00100000:3.0:1782756359.191130:0:14915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210089600 00000100:00100000:3.0:1782756359.191207:0:14915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6 00000100:00100000:3.0:1782756359.191218:0:14915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+6:13798:x1869355210089600:12345-192.168.204.25@tcp:13:lfs.0 00002000:00000024:3.0:1782756359.191257:0:14915:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782756359.191352:0:14915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+6:13798:x1869355210089600:12345-192.168.204.25@tcp:13:lfs.0 Request processed in 135us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756359.191360:0:14915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6 00000100:00080000:2.0:1782756359.192803:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782756359.244909:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756359.333816:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756359.335933:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210089728 00000100:00100000:3.0:1782756359.335959:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210089728 00000100:00100000:3.0:1782756359.336030:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 88 00000100:00100000:3.0:1782756359.336040:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76aca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a70182dd-4d00-4e89-9377-2e7b41557e6b+10:13831:x1869355210089728:12345-192.168.204.25@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782756359.336057:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756359.336249:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c40031600/0x5e4fb0a8aa199fcc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce2c3 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756359.336283:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c40031600/0x5e4fb0a8aa199fcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce2c3 expref: 11 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756359.336296:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c40031600/0x5e4fb0a8aa199fcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce2c3 expref: 11 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756359.336306:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c40031600, rc 0) 00000100:00100000:3.0:1782756359.336490:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76aca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a70182dd-4d00-4e89-9377-2e7b41557e6b+11:13831:x1869355210089728:12345-192.168.204.25@tcp:101:mount.lustre.0 Request processed in 450us (2683us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756359.336498:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 88 00000100:00100000:1.0:1782756359.340573:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756359.340682:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210089856 00000100:00100000:0.0:1782756359.340704:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210089856 00000100:00100000:0.0:1782756359.340764:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 89 00000100:00100000:0.0:1782756359.340775:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76aca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a70182dd-4d00-4e89-9377-2e7b41557e6b+11:13831:x1869355210089856:12345-192.168.204.25@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782756359.341220:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76aca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a70182dd-4d00-4e89-9377-2e7b41557e6b+11:13831:x1869355210089856:12345-192.168.204.25@tcp:501:mount.lustre.0 Request processed in 447us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756359.341229:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 89 00000100:00100000:1.0:1782756359.347992:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756359.348132:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210089984 00000100:00100000:3.0:1782756359.348155:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210089984 00000100:00100000:3.0:1782756359.348207:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 90 00000100:00100000:3.0:1782756359.348216:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76acb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a70182dd-4d00-4e89-9377-2e7b41557e6b+11:13831:x1869355210089984:12345-192.168.204.25@tcp:503:mount.lustre.0 00000100:00100000:3.0:1782756359.348541:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76acb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a70182dd-4d00-4e89-9377-2e7b41557e6b+11:13831:x1869355210089984:12345-192.168.204.25@tcp:503:mount.lustre.0 Request processed in 324us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756359.348550:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 90 00000100:00100000:1.0:1782756359.356367:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756359.356468:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210090112 00000100:00100000:2.0:1782756359.356478:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210090112 00000100:00100000:2.0:1782756359.356570:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 91 00000100:00100000:2.0:1782756359.356580:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76acb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a70182dd-4d00-4e89-9377-2e7b41557e6b+11:13837:x1869355210090112:12345-192.168.204.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782756359.357147:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76acb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a70182dd-4d00-4e89-9377-2e7b41557e6b+11:13837:x1869355210090112:12345-192.168.204.25@tcp:502:llog_process_th.0 Request processed in 566us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756359.357155:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 91 00000100:00100000:1.0:1782756359.374930:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756359.375496:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210090240 00000100:00100000:0.0:1782756359.375507:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210090240 00000100:00100000:0.0:1782756359.375615:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 92 00000100:00100000:0.0:1782756359.375627:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76ac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a70182dd-4d00-4e89-9377-2e7b41557e6b+11:13837:x1869355210090240:12345-192.168.204.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782756359.375896:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76ac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a70182dd-4d00-4e89-9377-2e7b41557e6b+11:13837:x1869355210090240:12345-192.168.204.25@tcp:502:llog_process_th.0 Request processed in 270us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756359.375904:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 92 00000100:00100000:1.0:1782756359.379211:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756359.379562:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210090368 00000100:00100000:2.0:1782756359.379572:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210090368 00000100:00100000:2.0:1782756359.379671:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 93 00000100:00100000:2.0:1782756359.379681:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c76acbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a70182dd-4d00-4e89-9377-2e7b41557e6b+11:13831:x1869355210090368:12345-192.168.204.25@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782756359.379710:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756359.379728:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4a63ce00/0x5e4fb0a8aa199fd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce2ed expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756359.379757:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4a63ce00/0x5e4fb0a8aa199fd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce2ed expref: 12 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756359.379768:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4a63ce00/0x5e4fb0a8aa199fd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce2ed expref: 12 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756359.379776:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63ce00, rc 0) 00000100:00100000:2.0:1782756359.379839:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c76acbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a70182dd-4d00-4e89-9377-2e7b41557e6b+12:13831:x1869355210090368:12345-192.168.204.25@tcp:101:mount.lustre.0 Request processed in 160us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756359.379845:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 93 00000100:00100000:1.0:1782756359.383742:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756359.383840:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210090496 00000100:00100000:0.0:1782756359.383850:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210090496 00000100:00100000:0.0:1782756359.383945:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 94 00000100:00100000:0.0:1782756359.383956:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a70182dd-4d00-4e89-9377-2e7b41557e6b+12:13831:x1869355210090496:12345-192.168.204.25@tcp:256:mount.lustre.0 20000000:01000000:0.0:1782756359.384015:0:14267:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1782756359.384035:0:14267:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1782756359.384040:0:14267:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1782756359.384043:0:14267:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1782756359.384045:0:14267:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1782756359.386701:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a70182dd-4d00-4e89-9377-2e7b41557e6b+12:13831:x1869355210090496:12345-192.168.204.25@tcp:256:mount.lustre.0 Request processed in 2717us (2939us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756359.386745:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 94 00000100:00100000:1.0:1782756359.391660:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756359.391823:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210090624 00000100:00100000:2.0:1782756359.391834:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210090624 00000100:00100000:2.0:1782756359.391891:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 95 00000100:00100000:2.0:1782756359.391902:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a70182dd-4d00-4e89-9377-2e7b41557e6b+12:13831:x1869355210090624:12345-192.168.204.25@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782756359.391921:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756359.392113:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c4a63d600/0x5e4fb0a8aa199fda lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce2f4 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756359.392146:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4a63d600/0x5e4fb0a8aa199fda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce2f4 expref: 13 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756359.392177:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c4a63d600/0x5e4fb0a8aa199fda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce2f4 expref: 13 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756359.392188:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63d600, rc 0) 00000100:00100000:2.0:1782756359.392256:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a70182dd-4d00-4e89-9377-2e7b41557e6b+13:13831:x1869355210090624:12345-192.168.204.25@tcp:101:mount.lustre.0 Request processed in 355us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756359.392264:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 95 00000100:00100000:1.0:1782756359.395115:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756359.395285:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210090752 00000100:00100000:0.0:1782756359.395298:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210090752 00000100:00100000:0.0:1782756359.395351:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 96 00000100:00100000:0.0:1782756359.395361:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a70182dd-4d00-4e89-9377-2e7b41557e6b+13:13831:x1869355210090752:12345-192.168.204.25@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782756359.395669:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a70182dd-4d00-4e89-9377-2e7b41557e6b+13:13831:x1869355210090752:12345-192.168.204.25@tcp:501:mount.lustre.0 Request processed in 308us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756359.395679:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 96 00000100:00100000:1.0:1782756359.398116:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756359.398180:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210090880 00000100:00100000:2.0:1782756359.398190:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210090880 00000100:00100000:2.0:1782756359.398308:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 97 00000100:00100000:2.0:1782756359.398318:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78eb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a70182dd-4d00-4e89-9377-2e7b41557e6b+13:13831:x1869355210090880:12345-192.168.204.25@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782756359.398866:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78eb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a70182dd-4d00-4e89-9377-2e7b41557e6b+13:13831:x1869355210090880:12345-192.168.204.25@tcp:503:mount.lustre.0 Request processed in 547us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756359.398877:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 97 00000100:00100000:1.0:1782756359.401715:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756359.403186:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210091008 00000100:00100000:3.0:1782756359.403299:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210091008 00000100:00100000:2.0:1782756359.403629:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 98 00000100:00100000:2.0:1782756359.403641:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78eba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a70182dd-4d00-4e89-9377-2e7b41557e6b+13:13841:x1869355210091008:12345-192.168.204.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782756359.403961:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78eba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a70182dd-4d00-4e89-9377-2e7b41557e6b+13:13841:x1869355210091008:12345-192.168.204.25@tcp:502:llog_process_th.0 Request processed in 320us (2253us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756359.403969:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 98 00000100:00100000:1.0:1782756359.407272:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756359.407820:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210091136 00000100:00100000:2.0:1782756359.407830:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210091136 00000100:00100000:2.0:1782756359.407947:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 99 00000100:00100000:2.0:1782756359.407959:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78ebac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a70182dd-4d00-4e89-9377-2e7b41557e6b+13:13841:x1869355210091136:12345-192.168.204.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782756359.408798:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78ebac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a70182dd-4d00-4e89-9377-2e7b41557e6b+13:13841:x1869355210091136:12345-192.168.204.25@tcp:502:llog_process_th.0 Request processed in 836us (1539us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756359.408814:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 99 00000100:00100000:1.0:1782756359.412263:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756359.412621:0:14272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210091264 00000100:00100000:0.0:1782756359.412631:0:14272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210091264 00000100:00100000:0.0:1782756359.412723:0:14272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 10 00000100:00100000:0.0:1782756359.412741:0:14272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2354:x1869355210091264:12345-192.168.204.25@tcp:38:mount.lustre.0 00010000:00080000:0.0:1782756359.412770:0:14272:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 9b674de3-88f4-4444-b144-96e2e5cb396a@192.168.204.25@tcp t0 exp 0000000000000000 cur 400 last 0 00000020:00000080:0.0:1782756359.412804:0:14272:0:(genops.c:1406:class_connect()) connect: client 9b674de3-88f4-4444-b144-96e2e5cb396a, cookie 0x5e4fb0a8aa199fe1 00000004:00100000:0.0:1782756359.412835:0:14272:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1782756359.412951:0:14272:0:(import.c:65:import_set_state_nolock()) ffff9d3c77949000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782756359.413026:0:14272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b674de3-88f4-4444-b144-96e2e5cb396a+6:2354:x1869355210091264:12345-192.168.204.25@tcp:38:mount.lustre.0 Request processed in 294us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756359.413046:0:14272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 10 00000100:00100000:1.0:1782756359.417379:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756359.417458:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210091392 00000100:00100000:3.0:1782756359.417469:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210091392 00000100:00100000:1.0:1782756359.417491:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756359.417541:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210091520 00000100:00100000:3.0:1782756359.417545:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210091520 00000100:00100000:3.0:1782756359.417574:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 11 00000100:00100000:3.0:1782756359.417582:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b674de3-88f4-4444-b144-96e2e5cb396a+7:0:x1869355210091392:12345-192.168.204.25@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782756359.417615:0:14274:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1782756359.417633:0:15590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 12 00000100:00100000:1.0:1782756359.417642:0:15590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b674de3-88f4-4444-b144-96e2e5cb396a+7:13831:x1869355210091520:12345-192.168.204.25@tcp:41:mount.lustre.0 00000004:00000024:1.0:1782756359.417655:0:15590:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1782756359.417691:0:15590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b674de3-88f4-4444-b144-96e2e5cb396a+7:13831:x1869355210091520:12345-192.168.204.25@tcp:41:mount.lustre.0 Request processed in 51us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756359.417695:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b674de3-88f4-4444-b144-96e2e5cb396a+7:0:x1869355210091392:12345-192.168.204.25@tcp:41:mount.lustre.0 Request processed in 100us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756359.417698:0:15590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 12 00000100:00100000:3.0:1782756359.417701:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 11 00000100:00080000:2.0:1782756359.417813:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782756359.421794:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756359.421887:0:15590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210091648 00000100:00100000:1.0:1782756359.421896:0:15590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210091648 00000100:00100000:1.0:1782756359.421957:0:15590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13 00000100:00100000:1.0:1782756359.421967:0:15590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b674de3-88f4-4444-b144-96e2e5cb396a+6:13831:x1869355210091648:12345-192.168.204.25@tcp:40:mount.lustre.0 00000100:00100000:1.0:1782756359.422061:0:15590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b674de3-88f4-4444-b144-96e2e5cb396a+6:13831:x1869355210091648:12345-192.168.204.25@tcp:40:mount.lustre.0 Request processed in 95us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756359.422069:0:15590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13 00000100:00100000:0.0:1782756359.427669:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756359.428866:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210091776 00000100:00100000:3.0:1782756359.428879:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210091776 00000100:00100000:3.0:1782756359.428927:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 11 00000100:00100000:3.0:1782756359.428936:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2354:x1869355210091776:12345-192.168.204.25@tcp:8:mount.lustre.0 00010000:00080000:3.0:1782756359.428968:0:14910:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 9b674de3-88f4-4444-b144-96e2e5cb396a@192.168.204.25@tcp t0 exp 0000000000000000 cur 400 last 0 00000020:00000080:3.0:1782756359.429006:0:14910:0:(genops.c:1406:class_connect()) connect: client 9b674de3-88f4-4444-b144-96e2e5cb396a, cookie 0x5e4fb0a8aa199fe8 00002000:00100000:3.0:1782756359.429019:0:14910:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9b674de3-88f4-4444-b144-96e2e5cb396a/ffff9d3c44e2d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782756359.429031:0:14910:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782756359.429335:0:14910:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782756359.429372:0:14910:0:(import.c:65:import_set_state_nolock()) ffff9d3c44e2c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782756359.429606:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b674de3-88f4-4444-b144-96e2e5cb396a+6:2354:x1869355210091776:12345-192.168.204.25@tcp:8:mount.lustre.0 Request processed in 668us (1954us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756359.429614:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 11 00000100:00100000:2.0:1782756359.429800:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756359.429914:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756359.430181:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210092032 00000100:00100000:3.0:1782756359.430196:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210092032 00000100:00100000:3.0:1782756359.430239:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1 00000100:00100000:3.0:1782756359.430246:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b674de3-88f4-4444-b144-96e2e5cb396a+6:13831:x1869355210092032:12345-192.168.204.25@tcp:33:mount.lustre.0 00000004:00200000:3.0:1782756359.430551:0:14276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1782756359.430680:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b674de3-88f4-4444-b144-96e2e5cb396a+6:13831:x1869355210092032:12345-192.168.204.25@tcp:33:mount.lustre.0 Request processed in 433us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756359.430695:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1 00000100:00100000:1.0:1782756359.431598:0:16051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210091904 00000100:00100000:1.0:1782756359.431607:0:16051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210091904 00000100:00100000:1.0:1782756359.431651:0:16051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 12 00000100:00100000:1.0:1782756359.431657:0:16051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2354:x1869355210091904:12345-192.168.204.25@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782756359.431694:0:16051:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 9b674de3-88f4-4444-b144-96e2e5cb396a@192.168.204.25@tcp t0 exp 0000000000000000 cur 400 last 0 00000020:00000080:1.0:1782756359.431723:0:16051:0:(genops.c:1406:class_connect()) connect: client 9b674de3-88f4-4444-b144-96e2e5cb396a, cookie 0x5e4fb0a8aa199fef 00002000:00100000:1.0:1782756359.431732:0:16051:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9b674de3-88f4-4444-b144-96e2e5cb396a/ffff9d3b421c1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782756359.431742:0:16051:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782756359.431840:0:16051:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782756359.431869:0:16051:0:(import.c:65:import_set_state_nolock()) ffff9d3b421c6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782756359.431910:0:16051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b674de3-88f4-4444-b144-96e2e5cb396a+6:2354:x1869355210091904:12345-192.168.204.25@tcp:8:mount.lustre.0 Request processed in 252us (2110us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756359.431916:0:16051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 12 00000100:00100000:2.0:1782756359.583565:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756359.583660:0:14272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210092160 00000100:00100000:3.0:1782756359.583670:0:14272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210092160 00000100:00100000:3.0:1782756359.583778:0:14272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14 00000100:00100000:3.0:1782756359.583788:0:14272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b674de3-88f4-4444-b144-96e2e5cb396a+6:13863:x1869355210092160:12345-192.168.204.25@tcp:101:mkdir.0 00010000:00010000:3.0:1782756359.583810:0:14272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756359.583835:0:14272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c40031400/0x5e4fb0a8aa199ff6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce31e expref: -99 pid: 14272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756359.583904:0:14272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c40030a00/0x5e4fb0a8aa199ffd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756359.583917:0:14272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c40030a00/0x5e4fb0a8aa199ffd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756359.583930:0:14272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c40030a00/0x5e4fb0a8aa199ffd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782756359.584173:0:14272:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782756359.584178:0:14272:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1782756359.584281:0:14272:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c40030a00/0x5e4fb0a8aa199ffd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756359.584310:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c40031400/0x5e4fb0a8aa199ff6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce31e expref: 8 pid: 14272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756359.584330:0:14272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c40030a00/0x5e4fb0a8aa199ffd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce31e expref: 7 pid: 14272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756359.584338:0:14272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c49e15f00) 00010000:00010000:3.0:1782756359.584352:0:14272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782756359.584355:0:14272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c40030a00, rc 0) 00000100:00100000:3.0:1782756359.584422:0:14272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b674de3-88f4-4444-b144-96e2e5cb396a+7:13863:x1869355210092160:12345-192.168.204.25@tcp:101:mkdir.0 Request processed in 635us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756359.584430:0:14272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14 00010000:00010000:3.0:1782756360.268215:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756361.164680:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782756361.164703:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222657664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782756361.164772:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756361.164831:0:14915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222657664 00000100:00100000:0.0:1782756361.164838:0:14915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222657664 00000100:00100000:0.0:1782756361.164891:0:14915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782756361.164900:0:14915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1869355222657664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782756361.164935:0:14915:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782756361.164978:0:14915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1869355222657664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756361.164985:0:14915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782756361.165033:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222657664:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1782756361.165183:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782756361.171152:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c770fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c7873c7-f262-4959-b911-d0a7cf42af86:3315:1869355222657792:0@lo:400:kworker.0 00000100:00100000:1.0:1782756361.171220:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756361.171261:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c770fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869355222658304:0@lo:400:kworker.0 00000100:00100000:1.0:1782756361.171286:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756361.171310:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782756361.171315:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c770fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869355222658176:0@lo:400:kworker.0 00000100:00100000:1.0:1782756361.171335:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756361.171361:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c770fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222657920:0@lo:400:kworker.0 00000100:00100000:1.0:1782756361.171398:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756361.171415:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782756361.171420:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c770ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869355222658048:0@lo:400:kworker.0 00000100:00100000:1.0:1782756361.171438:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756361.171557:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222657792 00000100:00100000:1.0:1782756361.171565:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222657792 00000100:00100000:1.0:1782756361.171611:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1782756361.171621:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7b937050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+19:3315:x1869355222657792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756361.171745:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7b937050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+19:3315:x1869355222657792:12345-0@lo:400:kworker.0 Request processed in 125us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756361.171753:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1782756361.171786:0:15590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222658304 00000100:00100000:1.0:1782756361.171790:0:15590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222658304 00000100:00100000:1.0:1782756361.171832:0:15590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222658176 00000100:00100000:1.0:1782756361.171836:0:15590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222658176 00000100:00100000:1.0:1782756361.171851:0:15590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222658048 00000100:00100000:1.0:1782756361.171854:0:15590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222658048 00000100:00100000:1.0:1782756361.171866:0:15590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782756361.171872:0:15590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869355222658304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756361.171903:0:15590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869355222658304:12345-0@lo:400:kworker.0 Request processed in 31us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756361.171909:0:15590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782756361.171921:0:15590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782756361.171928:0:15590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869355222658176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756361.171954:0:15590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869355222658176:12345-0@lo:400:kworker.0 Request processed in 27us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756361.171959:0:15590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782756361.171968:0:15590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782756361.171974:0:15590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869355222658048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756361.172002:0:15590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869355222658048:12345-0@lo:400:kworker.0 Request processed in 29us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756361.172008:0:15590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782756361.172024:0:14912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222657920 00000100:00100000:1.0:1782756361.172028:0:14912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222657920 00000100:00100000:1.0:1782756361.172055:0:14912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782756361.172061:0:14912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222657920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756361.172107:0:14912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222657920:12345-0@lo:400:kworker.0 Request processed in 47us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756361.172114:0:14912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782756361.172157:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c770fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869355222658176:0@lo:400:kworker.0 00000100:00100000:1.0:1782756361.172176:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c770fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c7873c7-f262-4959-b911-d0a7cf42af86:3315:1869355222657792:0@lo:400:kworker.0 00000100:00100000:1.0:1782756361.172186:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c770fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869355222658304:0@lo:400:kworker.0 00000100:00080000:1.0:1782756361.172214:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782756361.172218:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782756361.172232:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c770ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869355222658048:0@lo:400:kworker.0 00000100:00100000:1.0:1782756361.172243:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c770fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222657920:0@lo:400:kworker.0 00000001:00100000:1.0:1782756361.238545:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7f2479af-f49e-47f8-ab4c-80d5e6645c7e 00000001:00100000:1.0:1782756361.238565:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9b674de3-88f4-4444-b144-96e2e5cb396a 00000001:00080000:1.0:1782756361.238602:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1782756361.238625:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1782756361.292299:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782756361.601748:0:16137:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1782756361.708037:0:6627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7f2479af-f49e-47f8-ab4c-80d5e6645c7e 00000001:00100000:2.0:1782756361.708057:0:6627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9b674de3-88f4-4444-b144-96e2e5cb396a 00010000:00010000:3.0:1782756362.322665:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782756362.735866:0:5825:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9b674de3-88f4-4444-b144-96e2e5cb396a 00000001:00100000:3.0:1782756362.736378:0:5825:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7f2479af-f49e-47f8-ab4c-80d5e6645c7e 00010000:00010000:2.0:1782756363.343390:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756363.725508:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222658432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782756363.725577:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756363.725732:0:14915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222658432 00000100:00100000:0.0:1782756363.725743:0:14915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222658432 00000100:00100000:0.0:1782756363.725821:0:14915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782756363.725846:0:14915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222658432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782756363.725881:0:14915:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782756363.725940:0:14915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869355222658432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756363.725948:0:14915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1782756363.726019:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782756363.726027:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869355222658432:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1782756364.124692:0:16289:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda4c16990 20000000:00000080:2.0:1782756364.124711:0:16289:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d3c77bc2000 uarg=0000000000000000 20000000:01000000:2.0:1782756364.124745:0:16289:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1782756364.124751:0:16289:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1782756364.124756:0:16289:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1782756364.126609:0:16290:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1782756364.127030:0:16289:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1782756364.135414:0:16289:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1782756364.135446:0:16289:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a004 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756364.135465:0:16289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa199cfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199cf4 expref: 18 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756364.135472:0:16289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c76e17200/0x5e4fb0a8aa199d48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199d41 expref: 18 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756364.135479:0:16289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c40031000/0x5e4fb0a8aa199e7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa199e75 expref: 18 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756364.135780:0:16289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa199fa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce292 expref: 12 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756364.135790:0:16289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d3c4a63d600/0x5e4fb0a8aa199fda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce2f4 expref: 12 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756364.135798:0:16289:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a004 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756364.135847:0:16289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c4a63d600/0x5e4fb0a8aa199fda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce2f4 expref: 12 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756364.135934:0:16289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3c4a63d600/0x5e4fb0a8aa199fda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce2f4 expref: 12 pid: 14265 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756364.135950:0:16289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fbb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16289:1869355222658560:192.168.204.25@tcp:104: 00010000:00010000:2.0:1782756364.136167:0:16289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa199fa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce292 expref: 12 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756364.136177:0:16289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa199fa2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce292 expref: 12 pid: 14267 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756364.136186:0:16289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c80fbbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16289:1869355222658688:192.168.204.25@tcp:104: 00010000:00010000:2.0:1782756364.136218:0:16289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c40031000/0x5e4fb0a8aa199e7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa199e75 expref: 18 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756364.136227:0:16289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3c40031000/0x5e4fb0a8aa199e7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa199e75 expref: 18 pid: 14267 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756364.136249:0:16289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16289:1869355222658816:0@lo:104: 00000100:00100000:2.0:1782756364.136290:0:16289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782756364.136339:0:16289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c76e17200/0x5e4fb0a8aa199d48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa199d41 expref: 18 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756364.136346:0:16289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3c76e17200/0x5e4fb0a8aa199d48 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa199d41 expref: 18 pid: 14265 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756364.136354:0:16289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16289:1869355222658944:0@lo:104: 00000100:00100000:2.0:1782756364.136374:0:16289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782756364.136395:0:16289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa199cfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5e4fb0a8aa199cf4 expref: 18 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756364.136404:0:16289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa199cfb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5e4fb0a8aa199cf4 expref: 18 pid: 14266 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756364.136412:0:16289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16289:1869355222659072:0@lo:104: 00000100:00100000:1.0:1782756364.136485:0:14256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222658816 00000100:00100000:1.0:1782756364.136493:0:14256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222658816 00000100:00100000:1.0:1782756364.136537:0:14256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222658944 00000100:00100000:1.0:1782756364.136540:0:14256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222658944 00000100:00100000:1.0:1782756364.136554:0:14256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782756364.136562:0:14256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c7873c7-f262-4959-b911-d0a7cf42af86+4:16289:x1869355222658816:12345-0@lo:104: 00010000:00010000:1.0:1782756364.136576:0:14256:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef4800/0x5e4fb0a8aa199e75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa199e7c expref: -99 pid: 15578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756364.136628:0:14256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782756364.136634:0:14256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c7873c7-f262-4959-b911-d0a7cf42af86+4:16289:x1869355222658816:12345-0@lo:104: Request processed in 73us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756364.136647:0:14256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782756364.136663:0:14256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782756364.136669:0:14256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c7873c7-f262-4959-b911-d0a7cf42af86+3:16289:x1869355222658944:12345-0@lo:104: 00010000:00010000:1.0:1782756364.136676:0:14256:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef4400/0x5e4fb0a8aa199d41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa199d48 expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756364.136705:0:14256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782756364.136710:0:14256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c7873c7-f262-4959-b911-d0a7cf42af86+3:16289:x1869355222658944:12345-0@lo:104: Request processed in 42us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756364.136716:0:14256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1782756364.136716:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782756364.136723:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef4800/0x5e4fb0a8aa199e75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa199e7c expref: -99 pid: 15578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756364.136734:0:14260:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782756364.136741:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4800 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:0.0:1782756364.136745:0:14261:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef4800/0x5e4fb0a8aa199e75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa199e7c expref: -99 pid: 15578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756364.136754:0:14261:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef4800/0x5e4fb0a8aa199e75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa199e7c expref: -99 pid: 15578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782756364.136761:0:14261:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef4800/0x5e4fb0a8aa199e75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa199e7c expref: -99 pid: 15578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782756364.136767:0:14261:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782756364.136901:0:14261:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef4800/0x5e4fb0a8aa199e75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa199e7c expref: -99 pid: 15578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756364.136909:0:14261:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782756364.136929:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef4800/0x5e4fb0a8aa199e75 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa199e7c expref: -99 pid: 15578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756364.136936:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef4800/0x5e4fb0a8aa199e75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa199e7c expref: -99 pid: 15578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756364.136960:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756364.136962:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782756364.136964:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756364.136975:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c7873c7-f262-4959-b911-d0a7cf42af86:3317:1869355222659200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782756364.137003:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756364.137042:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222659200 00000100:00100000:0.0:1782756364.137046:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222659200 00010000:00010000:0.0:1782756364.137062:0:14257:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c40031000/0x5e4fb0a8aa199e7c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa199e75 expref: 19 pid: 14267 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756364.137107:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782756364.137113:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c7873c7-f262-4959-b911-d0a7cf42af86+19:3317:x1869355222659200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782756364.137124:0:14257:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756364.137128:0:14257:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c40031000/0x5e4fb0a8aa199e7c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa199e75 expref: 19 pid: 14267 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756364.137136:0:14257:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c40031000/0x5e4fb0a8aa199e7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa199e75 expref: 19 pid: 14267 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756364.137150:0:14257:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756364.137199:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c7873c7-f262-4959-b911-d0a7cf42af86+19:3317:x1869355222659200:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756364.137205:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782756364.137250:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c7873c7-f262-4959-b911-d0a7cf42af86:3317:1869355222659200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782756364.138255:0:16289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756364.138295:0:16289:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c48cc9780 going to sleep for 11 seconds 00010000:00010000:2.0:1782756364.138326:0:16289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c40031000/0x5e4fb0a8aa199e7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa199e75 expref: 18 pid: 14267 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756364.138341:0:16289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16289:1869355222658816:0@lo:104: 00000100:00100000:2.0:1782756364.138352:0:16289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16289:1869355222658944:0@lo:104: 00000100:00100000:3.0:1782756364.138893:0:14256:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1782756364.139134:0:16291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756364.139137:0:16291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756364.139138:0:16291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756364.139167:0:14260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef4400/0x5e4fb0a8aa199d41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa199d48 expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756364.139188:0:14260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4400 already unused, calling callback (ffffffffc1c85c20) 10000000:00010000:2.0:1782756364.139192:0:14260:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef4400/0x5e4fb0a8aa199d41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa199d48 expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756364.139202:0:14260:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef4400/0x5e4fb0a8aa199d41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa199d48 expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782756364.139209:0:14260:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef4400/0x5e4fb0a8aa199d41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa199d48 expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782756364.139215:0:14260:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782756364.139250:0:14260:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef4400/0x5e4fb0a8aa199d41 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa199d48 expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756364.139257:0:14260:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782756364.139277:0:14260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef4400/0x5e4fb0a8aa199d41 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa199d48 expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756364.139284:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c78ef4400/0x5e4fb0a8aa199d41 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa199d48 expref: -99 pid: 14909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756364.139296:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756364.139298:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756364.139299:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782756364.139446:0:14256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222659072 00000100:00100000:3.0:1782756364.139452:0:14256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222659072 00000100:00100000:3.0:1782756364.139514:0:14256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782756364.139522:0:14256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7993cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c7873c7-f262-4959-b911-d0a7cf42af86+3:16289:x1869355222659072:12345-0@lo:104: 00010000:00010000:3.0:1782756364.139532:0:14256:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.125@tcp lock: ffff9d3c4168c200/0x5e4fb0a8aa199cf4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa199cfb expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756364.139551:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c7873c7-f262-4959-b911-d0a7cf42af86:3314:1869355222659328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782756364.139584:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782756364.139591:0:14256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782756364.139597:0:14256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7993cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c7873c7-f262-4959-b911-d0a7cf42af86+3:16289:x1869355222659072:12345-0@lo:104: Request processed in 77us (3160us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756364.139604:0:14256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782756364.139623:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222659328 00000100:00100000:1.0:1782756364.139626:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222659328 00010000:00010000:1.0:1782756364.139641:0:14259:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c76e17200/0x5e4fb0a8aa199d48 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa199d41 expref: 18 pid: 14265 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756364.139648:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756364.139652:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.125@tcp lock: ffff9d3c4168c200/0x5e4fb0a8aa199cf4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5e4fb0a8aa199cfb expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756364.139659:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4168c200 already unused, calling callback (ffffffffc1c85c20) 00000100:00100000:1.0:1782756364.139661:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 10000000:00010000:3.0:1782756364.139662:0:14261:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4168c200/0x5e4fb0a8aa199cf4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5e4fb0a8aa199cfb expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756364.139667:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c7873c7-f262-4959-b911-d0a7cf42af86+18:3314:x1869355222659328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782756364.139669:0:14261:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.125@tcp lock: ffff9d3c4168c200/0x5e4fb0a8aa199cf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5e4fb0a8aa199cfb expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782756364.139675:0:14261:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.125@tcp lock: ffff9d3c4168c200/0x5e4fb0a8aa199cf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5e4fb0a8aa199cfb expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756364.139677:0:14259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:01000000:3.0:1782756364.139681:0:14261:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782756364.139682:0:14259:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c76e17200/0x5e4fb0a8aa199d48 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa199d41 expref: 18 pid: 14265 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756364.139690:0:14259:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c76e17200/0x5e4fb0a8aa199d48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa199d41 expref: 18 pid: 14265 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756364.139694:0:14261:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.125@tcp lock: ffff9d3c4168c200/0x5e4fb0a8aa199cf4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa199cfb expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756364.139699:0:14261:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782756364.139704:0:14259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c76e17200/0x5e4fb0a8aa199d48 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa199d41 expref: 18 pid: 14265 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756364.139709:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.125@tcp lock: ffff9d3c4168c200/0x5e4fb0a8aa199cf4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa199cfb expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756364.139722:0:14259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782756364.139724:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.125@tcp lock: ffff9d3c4168c200/0x5e4fb0a8aa199cf4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5e4fb0a8aa199cfb expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756364.139737:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756364.139738:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756364.139740:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782756364.139742:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c7873c7-f262-4959-b911-d0a7cf42af86+17:3314:x1869355222659328:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756364.139749:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782756364.139765:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c7873c7-f262-4959-b911-d0a7cf42af86:3315:1869355222659456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782756364.139789:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756364.139816:0:16289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16289:1869355222659072:0@lo:104: 00000100:00100000:3.0:1782756364.140107:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222659456 00000100:00100000:3.0:1782756364.140111:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222659456 00010000:00010000:3.0:1782756364.140125:0:14258:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa199cfb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa199cf4 expref: 17 pid: 14266 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756364.140150:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782756364.140157:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c465d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c7873c7-f262-4959-b911-d0a7cf42af86+17:3315:x1869355222659456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782756364.140164:0:14258:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756364.140169:0:14258:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa199cfb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5e4fb0a8aa199cf4 expref: 17 pid: 14266 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756364.140177:0:14258:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa199cfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5e4fb0a8aa199cf4 expref: 17 pid: 14266 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756364.140188:0:14258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4168d600/0x5e4fb0a8aa199cfb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5e4fb0a8aa199cf4 expref: 17 pid: 14266 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756364.140197:0:14258:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782756364.140464:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c7873c7-f262-4959-b911-d0a7cf42af86:3314:1869355222659328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782756364.140520:0:16289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fbb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16289:1869355222658560:192.168.204.25@tcp:104: 00000100:00100000:0.0:1782756364.140530:0:16289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c80fbbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16289:1869355222658688:192.168.204.25@tcp:104: 00010000:00010000:0.0:1782756364.140557:0:16289:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a004 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756364.140567:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c465d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c7873c7-f262-4959-b911-d0a7cf42af86+16:3315:x1869355222659456:12345-0@lo:103:ldlm_bl.0 Request processed in 410us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756364.140574:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782756364.140605:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c7873c7-f262-4959-b911-d0a7cf42af86:3315:1869355222659456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782756364.142060:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756364.142265:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756364.142279:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210092288 00000100:00100000:0.0:1782756364.142288:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210092288 00010000:00010000:0.0:1782756364.142333:0:14257:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c4a63d600/0x5e4fb0a8aa199fda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce2f4 expref: 13 pid: 14265 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756364.142396:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210092416 00000100:00100000:0.0:1782756364.142400:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210092416 00010000:00010000:0.0:1782756364.142414:0:14257:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa199fa2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce292 expref: 14 pid: 14267 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756364.142543:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7 00000100:00100000:2.0:1782756364.142558:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8 00000100:00100000:3.0:1782756364.142560:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a70182dd-4d00-4e89-9377-2e7b41557e6b+14:2356:x1869355210092288:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782756364.142573:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a70182dd-4d00-4e89-9377-2e7b41557e6b+14:2355:x1869355210092416:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782756364.142576:0:14258:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756364.142585:0:14258:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c4a63d600/0x5e4fb0a8aa199fda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce2f4 expref: 14 pid: 14265 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756364.142585:0:14259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756364.142601:0:14259:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa199fa2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce292 expref: 14 pid: 14267 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756364.142607:0:14258:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c4a63d600/0x5e4fb0a8aa199fda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce2f4 expref: 14 pid: 14265 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756364.142622:0:14259:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa199fa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce292 expref: 14 pid: 14267 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756364.142642:0:14258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4a63d600/0x5e4fb0a8aa199fda lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce2f4 expref: 14 pid: 14265 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756364.142647:0:14259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c40030c00/0x5e4fb0a8aa199fa2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce292 expref: 14 pid: 14267 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756364.142666:0:14258:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a004 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756364.142675:0:14258:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a004 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756364.142683:0:14259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782756364.142690:0:14258:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a004 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756364.142699:0:14258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a004 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756364.142705:0:14258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a004 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756364.142712:0:14258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a004 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756364.142718:0:14258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63c000 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756364.142722:0:14258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a004 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756364.142736:0:14258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a004 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756364.142745:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a70182dd-4d00-4e89-9377-2e7b41557e6b+12:2355:x1869355210092416:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 176us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756364.142753:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8 00010000:00010000:3.0:1782756364.142763:0:14258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a004 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756364.142776:0:14258:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782756364.142797:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a70182dd-4d00-4e89-9377-2e7b41557e6b+11:2356:x1869355210092288:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 240us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756364.142813:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7 00010000:00010000:1.0:1782756364.142878:0:16289:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a004 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756364.143048:0:16289:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a004 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756364.143055:0:16289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a004 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756364.364377:0:16291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782756364.589335:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756364.589386:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756364.589570:0:15590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210092672 00000100:00100000:1.0:1782756364.589581:0:15590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210092672 00000100:00100000:1.0:1782756364.589657:0:15590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13 00000100:00100000:1.0:1782756364.589668:0:15590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+6:2355:x1869355210092672:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1782756364.589738:0:15590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+6:2355:x1869355210092672:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 72us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756364.589763:0:15590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13 00000100:00080000:3.0:1782756364.589857:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782756364.589924:0:16051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210092928 00000100:00100000:0.0:1782756364.589929:0:16051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210092928 00000100:00080000:3.0:1782756364.589981:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782756364.590012:0:16051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3 00000100:00100000:0.0:1782756364.590021:0:16051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+5:2355:x1869355210092928:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756364.590064:0:16051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+5:2355:x1869355210092928:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 45us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756364.590071:0:16051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3 00000100:00100000:1.0:1782756364.590588:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756364.590631:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756364.590727:0:14912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210093184 00000100:00100000:0.0:1782756364.590732:0:14912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210093184 00000100:00100000:0.0:1782756364.590777:0:14912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 4 00000100:00100000:0.0:1782756364.590785:0:14912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b674de3-88f4-4444-b144-96e2e5cb396a+5:2355:x1869355210093184:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756364.590832:0:14912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b674de3-88f4-4444-b144-96e2e5cb396a+5:2355:x1869355210093184:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 49us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756364.590839:0:14912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 4 00000100:00080000:3.0:1782756364.590857:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782756364.590997:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756364.591025:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756364.591066:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756364.591326:0:14911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210092800 00000100:00100000:3.0:1782756364.591332:0:14911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210092800 00000100:00100000:3.0:1782756364.591428:0:14911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210093312 00000100:00100000:3.0:1782756364.591432:0:14911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210093312 00000100:00100000:0.0:1782756364.591438:0:14272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210093056 00000100:00100000:0.0:1782756364.591444:0:14272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210093056 00000100:00080000:1.0:1782756364.591464:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782756364.591469:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782756364.591471:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782756364.591493:0:14272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14 00000100:00100000:0.0:1782756364.591507:0:14272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b674de3-88f4-4444-b144-96e2e5cb396a+6:2355:x1869355210093056:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756364.591537:0:14911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5 00000100:00100000:3.0:1782756364.591546:0:14911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+5:2355:x1869355210092800:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756364.591552:0:14272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b674de3-88f4-4444-b144-96e2e5cb396a+6:2355:x1869355210093056:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 49us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756364.591582:0:14911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+5:2355:x1869355210092800:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 37us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756364.591589:0:14911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5 00000100:00100000:3.0:1782756364.591603:0:14911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6 00000100:00100000:3.0:1782756364.591609:0:14911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b674de3-88f4-4444-b144-96e2e5cb396a+5:2355:x1869355210093312:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756364.591631:0:14911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b674de3-88f4-4444-b144-96e2e5cb396a+5:2355:x1869355210093312:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 22us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756364.591649:0:14911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6 00000100:00100000:2.0:1782756364.592109:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210092544 00000100:00100000:2.0:1782756364.592114:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210092544 00000100:00100000:2.0:1782756364.592141:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 101 00000100:00100000:2.0:1782756364.592148:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7b934050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a70182dd-4d00-4e89-9377-2e7b41557e6b+11:2355:x1869355210092544:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:2.0:1782756364.592190:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7b934050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a70182dd-4d00-4e89-9377-2e7b41557e6b+11:2355:x1869355210092544:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 43us (1558us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756364.592197:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 101 00000100:00100000:0.0:1782756364.592854:0:14272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14 00000040:00080000:1.0:1782756364.620742:0:14307:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1782756365.388326:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782756365.517206:0:14269:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782756365.517213:0:14269:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9d3c44e2d000 from 10 10000000:01000000:3.0:1782756365.517218:0:14269:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782756365.517262:0:14269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c48256e00/0x5e4fb0a8aa19a00b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756365.517272:0:14269:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c48256e00/0x5e4fb0a8aa19a00b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756365.517293:0:14269:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c48256e00/0x5e4fb0a8aa19a00b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756365.517317:0:14269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e11f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222659584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782756365.517380:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756365.517436:0:14269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76f31000 going to sleep for 11 seconds 00000100:00100000:0.0:1782756365.517612:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222659584 00000100:00100000:0.0:1782756365.517619:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222659584 00000100:00100000:0.0:1782756365.517672:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1782756365.517681:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7b935050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+16:14269:x1869355222659584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782756365.517701:0:14267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756365.517715:0:14267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c76e16400/0x5e4fb0a8aa19a012 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa19a00b expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756365.517738:0:14267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c76e16400/0x5e4fb0a8aa19a012 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa19a00b expref: 17 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756365.517747:0:14267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c76e16400/0x5e4fb0a8aa19a012 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa19a00b expref: 17 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756365.517757:0:14267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c76e16400, rc 0) 00000100:00100000:0.0:1782756365.517806:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7b935050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+17:14269:x1869355222659584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756365.517812:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782756365.517890:0:14269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e11f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222659584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782756365.517903:0:14269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c48256e00/0x5e4fb0a8aa19a00b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa19a012 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756365.517911:0:14269:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c48256e00/0x5e4fb0a8aa19a00b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa19a012 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756365.517962:0:14269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e11f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222659712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782756365.517999:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756365.518026:0:14269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76f31000 going to sleep for 11 seconds 00000100:00100000:2.0:1782756365.518133:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222659712 00000100:00100000:2.0:1782756365.518138:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222659712 00000100:00100000:2.0:1782756365.518167:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1782756365.518174:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7b934850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+17:14269:x1869355222659712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782756365.518442:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7b934850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+17:14269:x1869355222659712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756365.518449:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1782756365.518771:0:14269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e11f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222659712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782756365.518813:0:14269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e11f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222659840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782756365.518850:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756365.518877:0:14269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76f31000 going to sleep for 11 seconds 00000100:00100000:2.0:1782756365.518919:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222659840 00000100:00100000:2.0:1782756365.518924:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222659840 00000100:00100000:2.0:1782756365.518946:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1782756365.518953:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7b937850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+17:14269:x1869355222659840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782756365.519143:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7b937850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+17:14269:x1869355222659840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756365.519150:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782756365.519295:0:14269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e11f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222659840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782756365.520776:0:16376:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1782756365.520936:0:14269:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1782756365.520957:0:14269:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782756365.520968:0:14269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c48256e00/0x5e4fb0a8aa19a00b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa19a012 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756365.520990:0:14269:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c48256e00/0x5e4fb0a8aa19a00b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa19a012 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782756365.521000:0:14269:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782756365.521003:0:14269:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9d3b41148000 from 10 10000000:01000000:0.0:1782756365.521005:0:14269:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782756365.521041:0:14269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c76e16c00/0x5e4fb0a8aa19a019 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756365.521049:0:14269:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c76e16c00/0x5e4fb0a8aa19a019 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756365.521071:0:14269:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c76e16c00/0x5e4fb0a8aa19a019 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756365.521134:0:14269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222659968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782756365.521191:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756365.521222:0:14269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c48f81900 going to sleep for 11 seconds 00000100:00100000:3.0:1782756365.521623:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222659968 00000100:00100000:3.0:1782756365.521630:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222659968 00000100:00100000:3.0:1782756365.521706:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1782756365.521715:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7b937450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+17:14269:x1869355222659968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782756365.521727:0:14267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756365.521740:0:14267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c48256200/0x5e4fb0a8aa19a020 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa19a019 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756365.521764:0:14267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c48256200/0x5e4fb0a8aa19a020 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa19a019 expref: 18 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756365.521775:0:14267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c48256200/0x5e4fb0a8aa19a020 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa19a019 expref: 18 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756365.521784:0:14267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c48256200, rc 0) 00000100:00100000:3.0:1782756365.521824:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7b937450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+18:14269:x1869355222659968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756365.521831:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782756365.521906:0:14269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222659968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782756365.521919:0:14269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c76e16c00/0x5e4fb0a8aa19a019 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa19a020 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756365.521928:0:14269:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c76e16c00/0x5e4fb0a8aa19a019 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa19a020 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756365.521991:0:14269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3b419fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222660096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782756365.522019:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756365.529148:0:14269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c48f81900 going to sleep for 11 seconds 00000100:00100000:2.0:1782756365.529515:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222660096 00000100:00100000:2.0:1782756365.529540:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222660096 00000100:00100000:2.0:1782756365.529590:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1782756365.529600:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7b937c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+18:14269:x1869355222660096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782756365.529853:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7b937c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+18:14269:x1869355222660096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (7832us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756365.529860:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1782756365.530185:0:14269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3b419fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222660096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782756365.530240:0:14269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c770fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222660224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782756365.530303:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756365.530330:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222660224 00000100:00100000:1.0:1782756365.530334:0:14269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c44e43900 going to sleep for 11 seconds 00000100:00100000:2.0:1782756365.530336:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222660224 00000100:00100000:2.0:1782756365.530359:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1782756365.530366:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7b934450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+18:14269:x1869355222660224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782756365.530513:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7b934450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+18:14269:x1869355222660224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756365.530522:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1782756365.530537:0:14269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c770fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222660224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782756365.532068:0:16377:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1782756365.532164:0:14269:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1782756365.532189:0:14269:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782756365.532206:0:14269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c76e16c00/0x5e4fb0a8aa19a019 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa19a020 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756365.532217:0:14269:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c76e16c00/0x5e4fb0a8aa19a019 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa19a020 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782756365.532227:0:14269:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782756365.532229:0:14269:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9d3c7fb26000 from 10 10000000:01000000:2.0:1782756365.532232:0:14269:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782756365.532264:0:14269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63c800/0x5e4fb0a8aa19a027 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756365.532272:0:14269:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63c800/0x5e4fb0a8aa19a027 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756365.532293:0:14269:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63c800/0x5e4fb0a8aa19a027 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756365.532315:0:14269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222660352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782756365.532369:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756365.532401:0:14269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c48784780 going to sleep for 11 seconds 00000100:00100000:3.0:1782756365.532475:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222660352 00000100:00100000:3.0:1782756365.532480:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222660352 00000100:00100000:3.0:1782756365.532520:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1782756365.532542:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7b936450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+18:14269:x1869355222660352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782756365.532561:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756365.532572:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c48256c00/0x5e4fb0a8aa19a02e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5e4fb0a8aa19a027 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756365.532593:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c48256c00/0x5e4fb0a8aa19a02e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5e4fb0a8aa19a027 expref: 19 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756365.532602:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c48256c00/0x5e4fb0a8aa19a02e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5e4fb0a8aa19a027 expref: 19 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756365.532610:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c48256c00, rc 0) 00000100:00100000:3.0:1782756365.532651:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7b936450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c7873c7-f262-4959-b911-d0a7cf42af86+19:14269:x1869355222660352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756365.532657:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1782756365.533524:0:14269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222660352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782756365.533543:0:14269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63c800/0x5e4fb0a8aa19a027 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa19a02e expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756365.533554:0:14269:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63c800/0x5e4fb0a8aa19a027 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5e4fb0a8aa19a02e expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756365.533637:0:14269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c770fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222660480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782756365.533676:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756365.533724:0:14269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c44e43f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782756365.534179:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222660480 00000100:00100000:0.0:1782756365.534185:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222660480 00000100:00100000:0.0:1782756365.534253:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782756365.534263:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7b936c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+19:14269:x1869355222660480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782756365.534748:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7b936c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+19:14269:x1869355222660480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 485us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756365.534757:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1782756365.535504:0:14269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c770fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222660480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782756365.535561:0:14269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c770fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222660608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782756365.535766:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756365.536459:0:14269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c44e43f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782756365.537687:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222660608 00000100:00100000:3.0:1782756365.537696:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222660608 00000100:00100000:3.0:1782756365.538069:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1782756365.538091:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7b934c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+19:14269:x1869355222660608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782756365.538317:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7b934c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+19:14269:x1869355222660608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 227us (2551us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756365.538325:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1782756365.538398:0:14269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c770fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c7873c7-f262-4959-b911-d0a7cf42af86:14269:1869355222660608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782756365.540048:0:16379:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1782756365.541045:0:14269:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1782756365.541070:0:14269:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782756365.541116:0:14269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63c800/0x5e4fb0a8aa19a027 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa19a02e expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756365.541129:0:14269:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.125@tcp lock: ffff9d3c4a63c800/0x5e4fb0a8aa19a027 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5e4fb0a8aa19a02e expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756365.804320:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756365.804360:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210093440 00000100:00100000:1.0:1782756365.804370:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210093440 00000100:00100000:1.0:1782756365.804423:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 111 00000100:00100000:1.0:1782756365.804433:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c43e07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a70182dd-4d00-4e89-9377-2e7b41557e6b+11:13717:x1869355210093440:12345-192.168.204.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782756365.804452:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756365.804470:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c41496c00/0x5e4fb0a8aa19a035 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce325 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756365.804501:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c41496c00/0x5e4fb0a8aa19a035 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce325 expref: 12 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756365.804514:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c41496c00/0x5e4fb0a8aa19a035 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce325 expref: 12 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756365.804531:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41496c00, rc 0) 00000100:00100000:1.0:1782756365.804598:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c43e07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a70182dd-4d00-4e89-9377-2e7b41557e6b+12:13717:x1869355210093440:12345-192.168.204.25@tcp:101:ll_cfg_requeue.0 Request processed in 167us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756365.804616:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 111 00000100:00100000:3.0:1782756365.812898:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756365.812935:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210093568 00000100:00100000:3.0:1782756365.812943:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210093568 00000100:00100000:3.0:1782756365.812992:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 112 00000100:00100000:3.0:1782756365.813002:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c43e06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a70182dd-4d00-4e89-9377-2e7b41557e6b+12:13717:x1869355210093568:12345-192.168.204.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782756365.813294:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c43e06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a70182dd-4d00-4e89-9377-2e7b41557e6b+12:13717:x1869355210093568:12345-192.168.204.25@tcp:501:ll_cfg_requeue.0 Request processed in 291us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756365.813309:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 112 00000100:00100000:0.0:1782756365.827259:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756365.827377:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210093696 00000100:00100000:3.0:1782756365.827388:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210093696 00000100:00100000:3.0:1782756365.827443:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 113 00000100:00100000:3.0:1782756365.827454:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c795c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a70182dd-4d00-4e89-9377-2e7b41557e6b+12:13717:x1869355210093696:12345-192.168.204.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782756365.827838:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c795c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a70182dd-4d00-4e89-9377-2e7b41557e6b+12:13717:x1869355210093696:12345-192.168.204.25@tcp:503:ll_cfg_requeue.0 Request processed in 385us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756365.827847:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 113 00000100:00100000:0.0:1782756365.840593:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756365.840726:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210093824 00000100:00100000:3.0:1782756365.840737:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210093824 00000100:00100000:3.0:1782756365.840793:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 114 00000100:00100000:3.0:1782756365.840850:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c795c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a70182dd-4d00-4e89-9377-2e7b41557e6b+12:13717:x1869355210093824:12345-192.168.204.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782756365.840872:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756365.840891:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d3c48257400/0x5e4fb0a8aa19a03c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce32c expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756365.840920:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d3c48257400/0x5e4fb0a8aa19a03c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce32c expref: 13 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756365.840931:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d3c48257400/0x5e4fb0a8aa19a03c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce32c expref: 13 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756365.840940:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c48257400, rc 0) 00000100:00100000:3.0:1782756365.840995:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c795c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a70182dd-4d00-4e89-9377-2e7b41557e6b+13:13717:x1869355210093824:12345-192.168.204.25@tcp:101:ll_cfg_requeue.0 Request processed in 150us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756365.841002:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 114 00000100:00100000:2.0:1782756365.846341:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756365.846436:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210093952 00000100:00100000:3.0:1782756365.846447:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210093952 00000100:00100000:3.0:1782756365.846507:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 115 00000100:00100000:3.0:1782756365.846518:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c795c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a70182dd-4d00-4e89-9377-2e7b41557e6b+13:13717:x1869355210093952:12345-192.168.204.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782756365.846823:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c795c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a70182dd-4d00-4e89-9377-2e7b41557e6b+13:13717:x1869355210093952:12345-192.168.204.25@tcp:501:ll_cfg_requeue.0 Request processed in 305us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756365.846831:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 115 00000100:00100000:3.0:1782756365.850557:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756365.850690:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210094080 00000100:00100000:0.0:1782756365.850704:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210094080 00000100:00100000:0.0:1782756365.850769:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 116 00000100:00100000:0.0:1782756365.850780:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c795c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a70182dd-4d00-4e89-9377-2e7b41557e6b+13:13717:x1869355210094080:12345-192.168.204.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782756365.851017:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c795c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a70182dd-4d00-4e89-9377-2e7b41557e6b+13:13717:x1869355210094080:12345-192.168.204.25@tcp:503:ll_cfg_requeue.0 Request processed in 238us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756365.851025:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 116 00000100:00100000:1.0:1782756366.284327:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222660864:0@lo:400:kworker.0 00000100:00100000:2.0:1782756366.284348:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222660992:0@lo:400:kworker.0 00000100:00100000:2.0:1782756366.284417:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756366.284476:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782756366.284483:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869355222661120:0@lo:400:kworker.0 00000100:00100000:2.0:1782756366.284510:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756366.284543:0:14911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222660992 00000100:00100000:2.0:1782756366.284550:0:14911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222660992 00000100:00100000:2.0:1782756366.284620:0:14911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782756366.284644:0:14911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222660992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756366.284671:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756366.284700:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869355222661376:0@lo:400:kworker.0 00000100:00100000:2.0:1782756366.284709:0:14911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222660992:12345-0@lo:400:kworker.0 Request processed in 67us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756366.284718:0:14911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782756366.284725:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756366.284735:0:14911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222660864 00000100:00100000:2.0:1782756366.284740:0:14911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222660864 00000100:00100000:1.0:1782756366.284746:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782756366.284754:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c7873c7-f262-4959-b911-d0a7cf42af86:3317:1869355222660736:0@lo:400:kworker.0 00000100:00100000:2.0:1782756366.284772:0:14911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782756366.284782:0:14911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222660864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756366.284787:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756366.284826:0:14911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222660864:12345-0@lo:400:kworker.0 Request processed in 45us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756366.284828:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869355222661248:0@lo:400:kworker.0 00000100:00100000:2.0:1782756366.284838:0:14911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782756366.284857:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756366.284866:0:15590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222661120 00000100:00100000:2.0:1782756366.284871:0:15590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222661120 00000100:00100000:1.0:1782756366.284893:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222660864:0@lo:400:kworker.0 00000100:00100000:2.0:1782756366.284897:0:15590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222661376 00000100:00100000:2.0:1782756366.284901:0:15590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222661376 00000100:00100000:2.0:1782756366.284917:0:15590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222661248 00000100:00100000:2.0:1782756366.284920:0:15590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222661248 00000100:00100000:1.0:1782756366.284941:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782756366.284950:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869355222661120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756366.284980:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869355222661120:12345-0@lo:400:kworker.0 Request processed in 32us (469us total) trans 0 rc 0/0 00000100:00080000:3.0:1782756366.285093:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782756366.285099:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782756366.285101:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782756366.285127:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869355222661120:0@lo:400:kworker.0 00000100:00100000:3.0:1782756366.285137:0:3314:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1782756366.285149:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222660992:0@lo:400:kworker.0 00000100:00100000:3.0:1782756366.285391:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222661504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782756366.285420:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756366.285460:0:14914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222661504 00000100:00100000:3.0:1782756366.285464:0:14914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222661504 00000100:00100000:0.0:1782756366.285505:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222660736 00000100:00100000:3.0:1782756366.285517:0:14914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782756366.285524:0:14914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222661504:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782756366.285548:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222660736 00000100:00100000:0.0:1782756366.285576:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1782756366.285582:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c795c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+19:3317:x1869355222660736:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1782756366.285619:0:14914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782756366.285687:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c795c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c7873c7-f262-4959-b911-d0a7cf42af86+19:3317:x1869355222660736:12345-0@lo:400:kworker.0 Request processed in 104us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756366.285693:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1782756366.285814:0:14914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222661504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 289us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756366.285820:0:14914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782756366.285850:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222661504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782756366.286180:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c7873c7-f262-4959-b911-d0a7cf42af86:3317:1869355222660736:0@lo:400:kworker.0 00000100:00100000:2.0:1782756366.286436:0:15590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782756366.286447:0:15590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869355222661376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756366.286484:0:15590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869355222661376:12345-0@lo:400:kworker.0 Request processed in 40us (1759us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756366.286490:0:15590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782756366.286503:0:15590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782756366.286510:0:15590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869355222661248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782756366.286539:0:15590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869355222661248:12345-0@lo:400:kworker.0 Request processed in 29us (1683us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756366.286545:0:15590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782756366.286904:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869355222661248:0@lo:400:kworker.0 00000100:00100000:3.0:1782756366.286921:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869355222661376:0@lo:400:kworker.0 00000100:00100000:1.0:1782756366.286957:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1782756366.412692:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782756366.965975:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756366.966264:0:15590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210094208 00000100:00100000:1.0:1782756366.966278:0:15590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210094208 00000100:00100000:1.0:1782756366.966379:0:15590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15 00000100:00100000:1.0:1782756366.966392:0:15590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+6:14373:x1869355210094208:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782756366.966439:0:15590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756366.966465:0:15590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a043 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce333 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.966563:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496000/0x5e4fb0a8aa19a04a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.966583:0:15590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496000/0x5e4fb0a8aa19a04a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.966598:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496000/0x5e4fb0a8aa19a04a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.966615:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a051 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.966621:0:15590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a051 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.966629:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a051 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.967556:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497200/0x5e4fb0a8aa19a058 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.967574:0:15590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497200/0x5e4fb0a8aa19a058 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.967585:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497200/0x5e4fb0a8aa19a058 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756366.967687:0:15590:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1782756366.967698:0:15590:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1782756366.967802:0:15590:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497200/0x5e4fb0a8aa19a058 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.967816:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496000/0x5e4fb0a8aa19a04a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.967823:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496000/0x5e4fb0a8aa19a04a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.967831:0:15590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496000/0x5e4fb0a8aa19a04a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.967837:0:15590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41496000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756366.967841:0:15590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496000/0x5e4fb0a8aa19a04a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.967848:0:15590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496000/0x5e4fb0a8aa19a04a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.967863:0:15590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c49e15f00) 00010000:00010000:1.0:1782756366.967867:0:15590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756366.967872:0:15590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496000/0x5e4fb0a8aa19a04a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.967878:0:15590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496000/0x5e4fb0a8aa19a04a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.967898:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a051 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782756366.968135:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782756366.970570:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a051 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.970614:0:15590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a051 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.970621:0:15590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41497e00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756366.970627:0:15590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a051 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.970929:0:15590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a051 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.970953:0:15590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9d3c49e15c00) 00010000:00010000:1.0:1782756366.970957:0:15590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756366.970962:0:15590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a051 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.970979:0:15590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a051 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.971069:0:15590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a043 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce333 expref: 8 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.971112:0:15590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497200/0x5e4fb0a8aa19a058 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce333 expref: 7 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.971121:0:15590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d3c49e15900) 00010000:00010000:1.0:1782756366.971123:0:15590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782756366.971125:0:15590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41497200, rc 0) 00000100:00100000:1.0:1782756366.971266:0:15590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+7:14373:x1869355210094208:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 4863us (5294us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756366.971289:0:15590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15 00000100:00100000:2.0:1782756366.981478:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756366.981862:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210094464 00000100:00100000:1.0:1782756366.981876:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210094464 00000100:00100000:1.0:1782756366.982381:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16 00000100:00100000:1.0:1782756366.982395:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+7:14373:x1869355210094464:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782756366.982424:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756366.982462:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a05f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce33a expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.982566:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a066 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.982584:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a066 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.982596:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a066 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.984789:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496000/0x5e4fb0a8aa19a06d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.984817:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496000/0x5e4fb0a8aa19a06d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.984830:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496000/0x5e4fb0a8aa19a06d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.985326:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497600/0x5e4fb0a8aa19a074 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.985510:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497600/0x5e4fb0a8aa19a074 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.985519:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497600/0x5e4fb0a8aa19a074 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756366.985533:0:14274:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1782756366.985795:0:14274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a066 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.985804:0:14274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a066 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.985810:0:14274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a066 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.985816:0:14274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41497e00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756366.985820:0:14274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a066 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.985826:0:14274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a066 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.985838:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d3c49e15900) 00010000:00010000:1.0:1782756366.985841:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756366.985845:0:14274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a066 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.985851:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a066 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.985864:0:14274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496000/0x5e4fb0a8aa19a06d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.985876:0:14274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496000/0x5e4fb0a8aa19a06d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.985882:0:14274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496000/0x5e4fb0a8aa19a06d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.985888:0:14274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41496000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756366.985891:0:14274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496000/0x5e4fb0a8aa19a06d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.985897:0:14274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496000/0x5e4fb0a8aa19a06d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.985905:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9d3c49e15c00) 00010000:00010000:1.0:1782756366.985908:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756366.985911:0:14274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496000/0x5e4fb0a8aa19a06d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.985916:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496000/0x5e4fb0a8aa19a06d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.986368:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a05f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce33a expref: 10 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.986385:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497600/0x5e4fb0a8aa19a074 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce33a expref: 9 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756366.986393:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3c49e15800) 00010000:00010000:1.0:1782756366.986395:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756366.986403:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41497600, rc 0) 00000100:00100000:1.0:1782756366.986478:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+9:14373:x1869355210094464:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 4085us (5025us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1782756366.986489:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16 00000100:00100000:3.0:1782756366.991219:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756366.991743:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210094592 00000100:00100000:2.0:1782756366.991757:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210094592 00000100:00100000:2.0:1782756366.991832:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17 00000100:00100000:2.0:1782756366.991844:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+9:14373:x1869355210094592:12345-192.168.204.25@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1782756366.991974:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+9:14373:x1869355210094592:12345-192.168.204.25@tcp:59:lhsmtool_posix.0 Request processed in 132us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756366.991983:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17 00000100:00100000:2.0:1782756367.027524:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756367.027782:0:14272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210094720 00000100:00100000:0.0:1782756367.027796:0:14272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210094720 00000100:00100000:0.0:1782756367.027875:0:14272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18 00000100:00100000:0.0:1782756367.027887:0:14272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+9:14379:x1869355210094720:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1782756367.027918:0:14272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756367.027954:0:14272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17800/0x5e4fb0a8aa19a082 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce341 expref: -99 pid: 14272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.028046:0:14272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17c00/0x5e4fb0a8aa19a089 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.028065:0:14272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17c00/0x5e4fb0a8aa19a089 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.028234:0:14272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17c00/0x5e4fb0a8aa19a089 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.028264:0:14272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16a00/0x5e4fb0a8aa19a090 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.028272:0:14272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16a00/0x5e4fb0a8aa19a090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.028279:0:14272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16a00/0x5e4fb0a8aa19a090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.028699:0:14272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17c00/0x5e4fb0a8aa19a089 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.028709:0:14272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17c00/0x5e4fb0a8aa19a089 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.028716:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17c00/0x5e4fb0a8aa19a089 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.028722:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c76e17c00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756367.028727:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17c00/0x5e4fb0a8aa19a089 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.028735:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17c00/0x5e4fb0a8aa19a089 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.028751:0:14272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c49e15f00) 00010000:00010000:0.0:1782756367.028755:0:14272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756367.028761:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17c00/0x5e4fb0a8aa19a089 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.028775:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17c00/0x5e4fb0a8aa19a089 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.028792:0:14272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16a00/0x5e4fb0a8aa19a090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.028798:0:14272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16a00/0x5e4fb0a8aa19a090 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.028804:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16a00/0x5e4fb0a8aa19a090 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.028809:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c76e16a00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756367.028813:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16a00/0x5e4fb0a8aa19a090 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.028819:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16a00/0x5e4fb0a8aa19a090 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.028826:0:14272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d3c54288600) 00010000:00010000:0.0:1782756367.028829:0:14272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756367.028832:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16a00/0x5e4fb0a8aa19a090 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.028846:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16a00/0x5e4fb0a8aa19a090 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.028887:0:14272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17800/0x5e4fb0a8aa19a082 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce341 expref: 10 pid: 14272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.028908:0:14272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c49e15f00) 00010000:00010000:0.0:1782756367.028911:0:14272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756367.028915:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17800/0x5e4fb0a8aa19a082 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce341 expref: 10 pid: 14272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.028924:0:14272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c76e17800, rc 0) 00000100:00100000:0.0:1782756367.029153:0:14272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+9:14379:x1869355210094720:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1266us (1642us total) trans 0 rc 301/301 00000100:00100000:0.0:1782756367.029163:0:14272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18 00000100:00100000:0.0:1782756367.035719:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756367.035886:0:14281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210094848 00000100:00100000:1.0:1782756367.035907:0:14281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210094848 00000100:00100000:1.0:1782756367.035999:0:14281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 0 00000100:00100000:1.0:1782756367.036012:0:14281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+9:14379:x1869355210094848:12345-192.168.204.25@tcp:700:lfs.0 00000100:00100000:1.0:1782756367.036183:0:14281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+9:14379:x1869355210094848:12345-192.168.204.25@tcp:700:lfs.0 Request processed in 174us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756367.036193:0:14281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 0 00000100:00100000:3.0:1782756367.038881:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756367.038993:0:15590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210095104 00000100:00100000:1.0:1782756367.039008:0:15590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210095104 00000100:00100000:1.0:1782756367.039148:0:15590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19 00000100:00100000:1.0:1782756367.039159:0:15590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+9:14379:x1869355210095104:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:1.0:1782756367.039215:0:15590:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756367.039244:0:15590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa199fc5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce2bc expref: 9 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.039279:0:15590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c49e15f00) 00010000:00010000:1.0:1782756367.039285:0:15590:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782756367.040910:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a097 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.040934:0:15590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c40030a00/0x5e4fb0a8aa199ffd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce31e expref: 5 pid: 14272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.040943:0:15590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a097 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.040992:0:15590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c40030a00/0x5e4fb0a8aa199ffd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce31e expref: 5 pid: 14272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.041006:0:15590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c40030a00/0x5e4fb0a8aa199ffd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce31e expref: 5 pid: 14272 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756367.041022:0:15590:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c770fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15590:1869355222661632:192.168.204.25@tcp:104: 00000100:00100000:1.0:1782756367.041143:0:15590:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c45346840 going to sleep for 11 seconds 00000100:00100000:1.0:1782756367.051339:0:15590:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c770fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15590:1869355222661632:192.168.204.25@tcp:104: 00010000:00010000:1.0:1782756367.051375:0:15590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a097 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756367.054769:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756367.054876:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210095232 00000100:00100000:0.0:1782756367.054891:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210095232 00010000:00010000:0.0:1782756367.054972:0:14257:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c40030a00/0x5e4fb0a8aa199ffd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce31e expref: 6 pid: 14272 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756367.055019:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9 00000100:00100000:0.0:1782756367.055029:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b674de3-88f4-4444-b144-96e2e5cb396a+6:2355:x1869355210095232:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782756367.055053:0:14257:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782756367.055060:0:14257:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c40030a00/0x5e4fb0a8aa199ffd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce31e expref: 6 pid: 14272 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.055123:0:14257:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c40030a00/0x5e4fb0a8aa199ffd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce31e expref: 6 pid: 14272 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.055148:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c40030a00/0x5e4fb0a8aa199ffd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce31e expref: 6 pid: 14272 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.055188:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c49e15f00) 00010000:00010000:0.0:1782756367.055194:0:14257:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a097 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.055203:0:14257:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a097 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.055210:0:14257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a097 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.055234:0:14257:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782756367.055313:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b674de3-88f4-4444-b144-96e2e5cb396a+5:2355:x1869355210095232:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 284us (553us total) trans 0 rc 0/0 00010000:00010000:1.0:1782756367.055314:0:15590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a097 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756367.055325:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9 00010000:00010000:1.0:1782756367.055328:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a097 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.055357:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa19a09e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.055367:0:15590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa19a09e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.055376:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa19a09e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782756367.056226:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1782756367.057128:0:15590:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1782756367.057148:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a097 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.057157:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a097 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.057164:0:15590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a097 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.057169:0:15590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41496800 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756367.057174:0:15590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a097 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.057181:0:15590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a097 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.057196:0:15590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c49e15f00) 00010000:00010000:1.0:1782756367.057199:0:15590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756367.057203:0:15590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a097 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.057209:0:15590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a097 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782756367.057236:0:15590:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ac0ff34f reply state 00000000cdd2254a transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa19a09e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756367.057245:0:15590:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782756367.057407:0:15590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+10:14379:x1869355210095104:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 18246us (18539us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1782756367.057417:0:15590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19 00010000:00010000:0.0:1782756367.062652:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa19a09e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.062672:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa19a09e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.062681:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa19a09e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.062687:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41497400 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756367.062694:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa19a09e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.062703:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa19a09e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.062758:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d3c49e15c00) 00010000:00010000:0.0:1782756367.062762:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756367.062767:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa19a09e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756367.062774:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa19a09e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756367.150633:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756367.150828:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210095360 00000100:00100000:1.0:1782756367.150859:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210095360 00000100:00100000:1.0:1782756367.150948:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20 00000100:00100000:1.0:1782756367.150961:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+9:14387:x1869355210095360:12345-192.168.204.25@tcp:101:lctl.0 00010000:00010000:1.0:1782756367.150998:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756367.151031:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a0a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce348 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.151162:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496000/0x5e4fb0a8aa19a0ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.151179:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496000/0x5e4fb0a8aa19a0ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.151192:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496000/0x5e4fb0a8aa19a0ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756367.151300:0:14274:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782756367.151304:0:14274:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1782756367.151355:0:14274:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496000/0x5e4fb0a8aa19a0ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.151387:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a0a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce348 expref: 11 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.151416:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496000/0x5e4fb0a8aa19a0ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce348 expref: 10 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.151427:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c49e15f00) 00010000:00010000:1.0:1782756367.151430:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782756367.151435:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41496000, rc 0) 00000100:00100000:1.0:1782756367.151537:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+10:14387:x1869355210095360:12345-192.168.204.25@tcp:101:lctl.0 Request processed in 578us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756367.151546:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20 00000100:00100000:3.0:1782756367.207464:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756367.207560:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210095488 00000100:00100000:2.0:1782756367.207574:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210095488 00000100:00100000:2.0:1782756367.207651:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 21 00000100:00100000:2.0:1782756367.207663:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b674de3-88f4-4444-b144-96e2e5cb396a+5:14388:x1869355210095488:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1782756367.207694:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756367.207731:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19a0b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce34f expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.207828:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa19a0ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.207847:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa19a0ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.207863:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa19a0ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756367.207950:0:14273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782756367.207954:0:14273:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1782756367.208008:0:14273:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa19a0ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.208040:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19a0b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce34f expref: 7 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.208068:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63dc00/0x5e4fb0a8aa19a0ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce34f expref: 6 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.208140:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c49e15f00) 00010000:00010000:2.0:1782756367.208143:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782756367.208148:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63dc00, rc 0) 00000100:00100000:2.0:1782756367.208233:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b674de3-88f4-4444-b144-96e2e5cb396a+6:14388:x1869355210095488:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 572us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756367.208243:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 21 00000100:00100000:2.0:1782756367.217212:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756367.217655:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210095616 00000100:00100000:1.0:1782756367.217670:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210095616 00000100:00100000:1.0:1782756367.217756:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 22 00000100:00100000:1.0:1782756367.217768:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b674de3-88f4-4444-b144-96e2e5cb396a+6:14388:x1869355210095616:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1782756367.217805:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756367.217832:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a0c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce356 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.217924:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a0c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.217941:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a0c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.217955:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a0c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.217973:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a0cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.217979:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a0cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.217985:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a0cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.221844:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497000/0x5e4fb0a8aa19a0d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.221883:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497000/0x5e4fb0a8aa19a0d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.221897:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497000/0x5e4fb0a8aa19a0d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756367.221977:0:14274:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1782756367.221981:0:14274:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782756367.222009:0:14274:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497000/0x5e4fb0a8aa19a0d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.222023:0:14274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a0c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.222178:0:14274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a0c8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.222187:0:14274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a0c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.222193:0:14274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41497e00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756367.222197:0:14274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a0c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.222205:0:14274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a0c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.222219:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c49e15f00) 00010000:00010000:1.0:1782756367.222223:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756367.222228:0:14274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a0c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.222263:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a0c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.222285:0:14274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a0cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.222291:0:14274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a0cf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.222297:0:14274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a0cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.222302:0:14274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41496600 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756367.222305:0:14274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a0cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.222311:0:14274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a0cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.222318:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d3c49e15b00) 00010000:00010000:1.0:1782756367.222321:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756367.222324:0:14274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a0cf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.222329:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a0cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.222379:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a0c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce356 expref: 8 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.222408:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497000/0x5e4fb0a8aa19a0d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce356 expref: 7 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.222415:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d3c49e15200) 00010000:00010000:1.0:1782756367.222418:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782756367.222420:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41497000, rc 0) 00000100:00100000:1.0:1782756367.222509:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b674de3-88f4-4444-b144-96e2e5cb396a+7:14388:x1869355210095616:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 4743us (5311us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756367.222519:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 22 00000100:00100000:0.0:1782756367.230176:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756367.231151:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210095872 00000100:00100000:2.0:1782756367.231171:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210095872 00000100:00100000:2.0:1782756367.231308:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 23 00000100:00100000:2.0:1782756367.231321:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b674de3-88f4-4444-b144-96e2e5cb396a+7:14388:x1869355210095872:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1782756367.231349:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756367.231375:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19a0dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce35d expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756367.231537:0:14273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1782756367.231695:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19a0dd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce35d expref: 9 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.231735:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c49e15f00) 00010000:00010000:2.0:1782756367.231738:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782756367.231744:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19a0dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce35d expref: 9 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.231763:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63cc00, rc 0) 00000100:00100000:2.0:1782756367.231847:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b674de3-88f4-4444-b144-96e2e5cb396a+8:14388:x1869355210095872:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 528us (1681us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1782756367.231856:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 23 00000100:00100000:0.0:1782756367.237362:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756367.238856:0:14272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210096128 00000100:00100000:2.0:1782756367.238875:0:14272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210096128 00000100:00100000:2.0:1782756367.238988:0:14272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 24 00000100:00100000:2.0:1782756367.239002:0:14272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b674de3-88f4-4444-b144-96e2e5cb396a+8:14388:x1869355210096128:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:2.0:1782756367.239499:0:14272:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756367.239550:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497000/0x5e4fb0a8aa19a0d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce356 expref: 8 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.239577:0:14272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d3c49e15200) 00010000:00010000:2.0:1782756367.239591:0:14272:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782756367.239623:0:14272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a0eb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.239639:0:14272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a0eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.239651:0:14272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a0eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782756367.241782:0:14272:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006766a0f6 reply state 00000000ab360b8a transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a0eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756367.241806:0:14272:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782756367.241841:0:14272:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1782756367.242002:0:14272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b674de3-88f4-4444-b144-96e2e5cb396a+9:14388:x1869355210096128:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 2996us (4649us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1782756367.242013:0:14272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 24 00010000:00010000:1.0:1782756367.245870:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a0eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.245893:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a0eb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.245911:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a0eb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.245918:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d600 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756367.245925:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a0eb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.245934:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a0eb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.245956:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d3c58212200) 00010000:00010000:1.0:1782756367.245960:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1782756367.245966:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a0eb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.246296:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a0eb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756367.247001:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756367.248156:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210096384 00000100:00100000:2.0:1782756367.248174:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210096384 00000100:00100000:2.0:1782756367.248257:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 2 00000100:00100000:2.0:1782756367.248271:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b674de3-88f4-4444-b144-96e2e5cb396a+8:14388:x1869355210096384:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:2.0:1782756367.248626:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b674de3-88f4-4444-b144-96e2e5cb396a+9:14388:x1869355210096384:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 357us (1631us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1782756367.248635:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 2 00000100:00100000:0.0:1782756367.252754:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756367.253359:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210096640 00000100:00100000:2.0:1782756367.253372:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210096640 00000100:00100000:2.0:1782756367.253454:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 25 00000100:00100000:2.0:1782756367.253466:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b674de3-88f4-4444-b144-96e2e5cb396a+9:14388:x1869355210096640:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1782756367.253499:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756367.253528:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19a0f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce364 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.253629:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a0f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.253646:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a0f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.253677:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a0f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.253694:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a100 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.253701:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.253708:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756367.253905:0:14273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1782756367.254790:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a0f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.254807:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a0f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.254815:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a0f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.254822:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63c000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756367.254828:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a0f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.254958:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a0f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.254979:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c49e15f00) 00010000:00010000:2.0:1782756367.255467:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756367.255491:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a0f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.255499:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a0f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.255522:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.255529:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a100 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.255548:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a100 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.255554:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756367.255558:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a100 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.255564:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a100 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.255574:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d3c58212600) 00010000:00010000:2.0:1782756367.255576:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756367.255579:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a100 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.255585:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a100 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.255655:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19a0f2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce364 expref: 11 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.255679:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c49e15f00) 00010000:00010000:2.0:1782756367.255681:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782756367.255685:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19a0f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce364 expref: 11 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.255696:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63cc00, rc 0) 00000100:00100000:2.0:1782756367.256353:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b674de3-88f4-4444-b144-96e2e5cb396a+10:14388:x1869355210096640:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2884us (3610us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1782756367.256366:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 25 00000100:00100000:0.0:1782756367.265473:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756367.268040:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210096768 00000100:00100000:1.0:1782756367.268065:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210096768 00000100:00100000:1.0:1782756367.268368:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 26 00000100:00100000:1.0:1782756367.268380:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b674de3-88f4-4444-b144-96e2e5cb396a+10:14388:x1869355210096768:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1782756367.268412:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756367.268441:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a10e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce36b expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.268568:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a115 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.268586:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a115 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.268598:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a115 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756367.268659:0:14274:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1782756367.268663:0:14274:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782756367.268687:0:14274:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a115 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.268716:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a10e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce36b expref: 12 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.268741:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a115 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce36b expref: 11 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.268769:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d3c49e15b00) 00010000:00010000:1.0:1782756367.268773:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782756367.268777:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41496600, rc 0) 00000100:00100000:1.0:1782756367.269238:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b674de3-88f4-4444-b144-96e2e5cb396a+11:14388:x1869355210096768:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 854us (3784us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756367.269260:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 26 00000100:00100000:0.0:1782756367.275783:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756367.275970:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210096896 00000100:00100000:2.0:1782756367.275983:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210096896 00000100:00100000:2.0:1782756367.276061:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3 00000100:00100000:2.0:1782756367.276115:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b674de3-88f4-4444-b144-96e2e5cb396a+11:14388:x1869355210096896:12345-192.168.204.25@tcp:37:lfs.0 00000100:00100000:2.0:1782756367.285691:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b674de3-88f4-4444-b144-96e2e5cb396a+11:14388:x1869355210096896:12345-192.168.204.25@tcp:37:lfs.0 Request processed in 9599us (9903us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756367.285711:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3 00000100:00100000:0.0:1782756367.289358:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756367.290460:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210097152 00000100:00100000:3.0:1782756367.290477:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210097152 00000100:00100000:3.0:1782756367.290705:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 4 00000100:00100000:3.0:1782756367.290719:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c44cc7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b674de3-88f4-4444-b144-96e2e5cb396a+11:14388:x1869355210097152:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:3.0:1782756367.293501:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c44cc7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b674de3-88f4-4444-b144-96e2e5cb396a+12:14388:x1869355210097152:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 1657us (3031us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1782756367.293525:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 4 00000100:00100000:0.0:1782756367.366779:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756367.366969:0:15590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210097280 00000100:00100000:1.0:1782756367.366982:0:15590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210097280 00000100:00100000:1.0:1782756367.367068:0:15590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 27 00000100:00100000:1.0:1782756367.367128:0:15590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+10:14394:x1869355210097280:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:1.0:1782756367.367157:0:15590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756367.367193:0:15590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a11c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce372 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.367318:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a123 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.367348:0:15590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a123 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.367371:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a123 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.367393:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a12a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.367401:0:15590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a12a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.367435:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a12a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.367890:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497000/0x5e4fb0a8aa19a131 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.367903:0:15590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497000/0x5e4fb0a8aa19a131 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.367911:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497000/0x5e4fb0a8aa19a131 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756367.367952:0:15590:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1782756367.367957:0:15590:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782756367.368320:0:15590:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497000/0x5e4fb0a8aa19a131 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.368343:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a123 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.368355:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a123 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.368367:0:15590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a123 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.368376:0:15590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41497e00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756367.368382:0:15590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a123 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.368394:0:15590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a123 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.368425:0:15590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c49e15f00) 00010000:00010000:1.0:1782756367.368428:0:15590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756367.368435:0:15590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a123 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.368441:0:15590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a123 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.368459:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a12a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.368465:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a12a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.368470:0:15590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a12a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.368476:0:15590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41496400 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756367.368479:0:15590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a12a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.368485:0:15590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a12a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.368493:0:15590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d3c49e15000) 00010000:00010000:1.0:1782756367.368495:0:15590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756367.368498:0:15590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a12a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.368504:0:15590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a12a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.368763:0:15590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a11c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce372 expref: 12 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.368783:0:15590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497000/0x5e4fb0a8aa19a131 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce372 expref: 11 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.368791:0:15590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d3c49e15b00) 00010000:00010000:1.0:1782756367.368794:0:15590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782756367.368796:0:15590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41497000, rc 0) 00000100:00100000:1.0:1782756367.368901:0:15590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+11:14394:x1869355210097280:12345-192.168.204.25@tcp:101:bash.0 Request processed in 1776us (2533us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756367.368911:0:15590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 27 00000100:00100000:0.0:1782756367.371996:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756367.372125:0:14272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210097536 00000100:00100000:2.0:1782756367.372140:0:14272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210097536 00000100:00100000:2.0:1782756367.372215:0:14272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 28 00000100:00100000:2.0:1782756367.372228:0:14272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+11:14394:x1869355210097536:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:2.0:1782756367.372270:0:14272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756367.372301:0:14272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19a138 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce379 expref: -99 pid: 14272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.372495:0:14272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a13f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.372525:0:14272:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a115 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce36b expref: 11 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.372534:0:14272:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a13f lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.372578:0:14272:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a115 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce36b expref: 11 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.372592:0:14272:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a115 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce36b expref: 11 pid: 14274 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756367.372608:0:14272:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14272:1869355222661760:192.168.204.25@tcp:104: 00000100:00100000:2.0:1782756367.372737:0:14272:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c48784780 going to sleep for 11 seconds 00000100:00100000:2.0:1782756367.374623:0:14272:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14272:1869355222661760:192.168.204.25@tcp:104: 00010000:00010000:2.0:1782756367.374660:0:14272:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a13f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756367.375680:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756367.375798:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210097664 00000100:00100000:3.0:1782756367.375813:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210097664 00010000:00010000:3.0:1782756367.375879:0:14258:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a115 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce36b expref: 12 pid: 14274 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756367.375939:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 10 00000100:00100000:3.0:1782756367.375952:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b674de3-88f4-4444-b144-96e2e5cb396a+12:2356:x1869355210097664:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782756367.375974:0:14258:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756367.376004:0:14258:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a115 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce36b expref: 12 pid: 14274 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756367.376025:0:14258:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a115 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce36b expref: 12 pid: 14274 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756367.376059:0:14258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a115 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce36b expref: 12 pid: 14274 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756367.376137:0:14258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d3c49e15b00) 00010000:00010000:3.0:1782756367.376144:0:14258:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a13f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756367.376161:0:14258:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a13f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756367.376171:0:14258:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a13f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756367.376212:0:14258:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782756367.376300:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b674de3-88f4-4444-b144-96e2e5cb396a+11:2356:x1869355210097664:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 350us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756367.376309:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 10 00010000:00010000:2.0:1782756367.376595:0:14272:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a13f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.376605:0:14272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a13f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.376640:0:14272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a146 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.376653:0:14272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a146 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.376671:0:14272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a146 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.378130:0:14272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a14d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.378150:0:14272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a14d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.378164:0:14272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a14d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756367.378179:0:14272:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1782756367.378220:0:14272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a13f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.378229:0:14272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a13f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.378236:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a13f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.378255:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756367.378261:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a13f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.378269:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a13f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.378284:0:14272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d3c49e15b00) 00010000:00010000:2.0:1782756367.378288:0:14272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756367.378309:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a13f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.378316:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a13f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782756367.378334:0:14272:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f816a5a4 reply state 00000000e4cbdd5a transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a146 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756367.378345:0:14272:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782756367.378396:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19a138 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce379 expref: 14 pid: 14272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.378413:0:14272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a14d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce379 expref: 13 pid: 14272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.378421:0:14272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d3c58212100) 00010000:00010000:2.0:1782756367.378424:0:14272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1782756367.378427:0:14272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63d800, rc 0) 00000100:00100000:2.0:1782756367.378512:0:14272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+14:14394:x1869355210097536:12345-192.168.204.25@tcp:101:bash.0 Request processed in 6286us (6532us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1782756367.378522:0:14272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 28 00010000:00010000:3.0:1782756367.389192:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a146 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756367.389515:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a146 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756367.389526:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a146 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756367.389553:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63c000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756367.389560:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a146 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756367.389569:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a146 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756367.389591:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9d3c58212600) 00010000:00010000:3.0:1782756367.389595:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782756367.389601:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a146 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756367.389607:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a146 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756367.402053:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756367.402396:0:15590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210097792 00000100:00100000:2.0:1782756367.402411:0:15590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210097792 00000100:00100000:2.0:1782756367.402531:0:15590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 29 00000100:00100000:2.0:1782756367.402545:0:15590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+13:14394:x1869355210097792:12345-192.168.204.25@tcp:101:bash.0 00010000:00010000:2.0:1782756367.402584:0:15590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756367.402612:0:15590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19a15b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce380 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.402736:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a162 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.402754:0:15590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a162 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.402768:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a162 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756367.402892:0:15590:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1782756367.402898:0:15590:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782756367.402922:0:15590:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a162 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.402935:0:15590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a162 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.402965:0:15590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19a15b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce380 expref: 15 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.402989:0:15590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a162 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce380 expref: 14 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.402999:0:15590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d3c58212100) 00010000:00010000:2.0:1782756367.403003:0:15590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782756367.403007:0:15590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63d000, rc 0) 00000100:00100000:2.0:1782756367.403357:0:15590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+14:14394:x1869355210097792:12345-192.168.204.25@tcp:101:bash.0 Request processed in 814us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756367.403367:0:15590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 29 00000100:00100000:0.0:1782756367.408498:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756367.408605:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210098048 00000100:00100000:2.0:1782756367.408619:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210098048 00000100:00100000:2.0:1782756367.408694:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5 00000100:00100000:2.0:1782756367.408706:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+14:14394:x1869355210098048:12345-192.168.204.25@tcp:35:bash.0 00000100:00100000:2.0:1782756367.409409:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+15:14394:x1869355210098048:12345-192.168.204.25@tcp:35:bash.0 Request processed in 700us (924us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1782756367.409421:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5 00010000:00010000:2.0:1782756367.436494:0:16291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756367.497034:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756367.497197:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210098304 00000100:00100000:1.0:1782756367.497210:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210098304 00000100:00100000:1.0:1782756367.497304:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 30 00000100:00100000:1.0:1782756367.497317:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+15:14404:x1869355210098304:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1782756367.497359:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756367.497388:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a169 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce387 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756367.497601:0:14274:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1782756367.497771:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a169 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce387 expref: 17 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.497790:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d3c49e15f00) 00010000:00010000:1.0:1782756367.497793:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782756367.497818:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a169 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce387 expref: 17 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.497840:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41496400, rc 0) 00000100:00100000:1.0:1782756367.497932:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+16:14404:x1869355210098304:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 617us (911us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1782756367.497940:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 30 00000100:00100000:0.0:1782756367.505728:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756367.505875:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210098560 00000100:00100000:2.0:1782756367.505890:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210098560 00000100:00100000:2.0:1782756367.506002:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6 00000100:00100000:2.0:1782756367.506016:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+16:14404:x1869355210098560:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:2.0:1782756367.506488:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+17:14404:x1869355210098560:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 471us (773us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1782756367.506499:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6 00000100:00100000:3.0:1782756367.556382:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756367.556521:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210098816 00000100:00100000:1.0:1782756367.556534:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210098816 00000100:00100000:1.0:1782756367.556629:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 31 00000100:00100000:1.0:1782756367.556654:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+17:14407:x1869355210098816:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1782756367.556693:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756367.556720:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a177 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce38e expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.556869:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a17e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.556886:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a17e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.556902:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a17e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782756367.556917:0:14273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1782756367.557130:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a177 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce38e expref: 20 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.557160:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a17e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce38e expref: 19 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.557189:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d3c58212100) 00010000:00010000:1.0:1782756367.557193:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782756367.557198:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41497e00, rc 0) 00000100:00100000:1.0:1782756367.557305:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+19:14407:x1869355210098816:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 666us (937us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1782756367.557315:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 31 00000100:00100000:0.0:1782756367.563946:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756367.564019:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756367.564714:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210098944 00000100:00100000:2.0:1782756367.564730:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210098944 00000100:00100000:2.0:1782756367.564829:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 0 00000100:00100000:2.0:1782756367.564842:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43616300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+19:2358:x1869355210098944:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782756367.564865:0:14259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756367.565029:0:14259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a17e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce38e expref: 19 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.565059:0:14259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d3c58212100) 00010000:00010000:2.0:1782756367.565065:0:14259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782756367.565525:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43616300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+18:2358:x1869355210098944:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 683us (1592us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756367.565713:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210099072 00000100:00100000:1.0:1782756367.565721:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210099072 00000100:00100000:1.0:1782756367.565771:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 32 00000100:00100000:1.0:1782756367.565780:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+19:14407:x1869355210099072:12345-192.168.204.25@tcp:54:lfs.0 00010000:00010000:1.0:1782756367.565859:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a18c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.565878:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a18c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.565965:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a18c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.566008:0:14274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a18c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.566015:0:14274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a18c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.566021:0:14274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a18c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.566027:0:14274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41496400 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756367.566050:0:14274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a18c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.566059:0:14274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a18c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.566070:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d3c58212100) 00010000:00010000:1.0:1782756367.566094:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:2.0:1782756367.567012:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 0 00010000:00010000:1.0:1782756367.567194:0:14274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a18c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.567205:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a18c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756367.567318:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+18:14407:x1869355210099072:12345-192.168.204.25@tcp:54:lfs.0 Request processed in 1537us (3296us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756367.567327:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 32 00000100:00100000:0.0:1782756367.572742:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756367.572829:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210099328 00000100:00100000:3.0:1782756367.572842:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210099328 00000100:00100000:3.0:1782756367.572914:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7 00000100:00100000:3.0:1782756367.572925:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+18:14407:x1869355210099328:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:3.0:1782756367.574393:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+19:14407:x1869355210099328:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 1459us (1653us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1782756367.574406:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7 00000040:00080000:1.0:1782756367.703814:0:14307:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1782756367.858115:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756367.858187:0:15590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210099584 00000100:00100000:2.0:1782756367.858198:0:15590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210099584 00000100:00100000:2.0:1782756367.858269:0:15590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 33 00000100:00100000:2.0:1782756367.858280:0:15590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+19:14438:x1869355210099584:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1782756367.858309:0:15590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756367.858330:0:15590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19a193 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce395 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.858446:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa19a19a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.858461:0:15590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa19a19a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.858475:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa19a19a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756367.858486:0:15590:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1782756367.858646:0:15590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19a193 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce395 expref: 22 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.858664:0:15590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa19a19a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce395 expref: 21 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.858684:0:15590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d3c58212100) 00010000:00010000:2.0:1782756367.858688:0:15590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782756367.858691:0:15590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63c600, rc 0) 00000100:00100000:2.0:1782756367.858750:0:15590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+21:14438:x1869355210099584:12345-192.168.204.25@tcp:101:cat.0 Request processed in 471us (674us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1782756367.858757:0:15590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 33 00000100:00100000:1.0:1782756367.869294:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756367.869375:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756367.870220:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210099968 00000100:00100000:3.0:1782756367.870231:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210099968 00000100:00100000:3.0:1782756367.870307:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1 00000100:00100000:3.0:1782756367.870316:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+21:2356:x1869355210099968:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782756367.870349:0:14257:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756367.870375:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa19a19a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce395 expref: 21 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756367.870394:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d3c58212100) 00010000:00010000:3.0:1782756367.870399:0:14257:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782756367.870454:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+20:2356:x1869355210099968:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 139us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756367.870461:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1 00000100:00100000:0.0:1782756367.870627:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210099840 00000100:00100000:0.0:1782756367.870632:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210099840 00000100:00100000:0.0:1782756367.870666:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8 00000100:00100000:0.0:1782756367.870673:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+20:14438:x1869355210099840:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:0.0:1782756367.870922:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+21:14438:x1869355210099840:12345-192.168.204.25@tcp:35:cat.0 Request processed in 250us (1638us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1782756367.870929:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8 00000001:00080000:3.0:1782756367.885982:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934604 is committed 00000001:00080000:3.0:1782756367.886023:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:3.0:1782756367.886047:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934605 is committed 00000001:00080000:3.0:1782756367.886053:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1782756367.963295:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756367.963402:0:14272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210100224 00000100:00100000:2.0:1782756367.963413:0:14272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210100224 00000100:00100000:2.0:1782756367.963499:0:14272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 34 00000100:00100000:2.0:1782756367.963509:0:14272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+13:14444:x1869355210100224:12345-192.168.204.25@tcp:101:dd.0 00010000:00010000:2.0:1782756367.963548:0:14272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756367.963574:0:14272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19a1a8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce39c expref: -99 pid: 14272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.963691:0:14272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d400/0x5e4fb0a8aa19a1af lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.963705:0:14272:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a14d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce379 expref: 14 pid: 14272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.963713:0:14272:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a162 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce380 expref: 14 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.963720:0:14272:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d400/0x5e4fb0a8aa19a1af lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.963763:0:14272:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a162 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce380 expref: 14 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.963776:0:14272:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a162 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce380 expref: 14 pid: 15590 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756367.963810:0:14272:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14272:1869355222661888:192.168.204.25@tcp:104: 00010000:00010000:2.0:1782756367.964458:0:14272:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a14d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce379 expref: 14 pid: 14272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.964468:0:14272:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a14d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce379 expref: 14 pid: 14272 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756367.964478:0:14272:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14272:1869355222662016:192.168.204.25@tcp:104: 00000100:00100000:2.0:1782756367.964513:0:14272:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c50115000 going to sleep for 11 seconds 00000100:00100000:0.0:1782756367.973307:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756367.973808:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210100352 00000100:00100000:3.0:1782756367.973817:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210100352 00010000:00010000:3.0:1782756367.973862:0:14259:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a162 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce380 expref: 15 pid: 15590 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756367.973909:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 11 00000100:00100000:3.0:1782756367.973919:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c465d1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+15:2356:x1869355210100352:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782756367.973934:0:14259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756367.973941:0:14259:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a162 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce380 expref: 15 pid: 15590 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756367.973954:0:14259:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a162 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce380 expref: 15 pid: 15590 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756367.974011:0:14259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d3c58212100) 00010000:00010000:3.0:1782756367.974016:0:14259:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d400/0x5e4fb0a8aa19a1af lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756367.974041:0:14259:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d400/0x5e4fb0a8aa19a1af lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756367.974048:0:14259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782756367.974135:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c465d1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+15:2356:x1869355210100352:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 216us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756367.974143:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 11 00010000:00010000:2.0:1782756367.974496:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a162 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce380 expref: 14 pid: 15590 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756367.974516:0:14272:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14272:1869355222661888:192.168.204.25@tcp:104: 00000100:00100000:2.0:1782756367.980804:0:14272:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14272:1869355222662016:192.168.204.25@tcp:104: 00010000:00010000:2.0:1782756367.980839:0:14272:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d400/0x5e4fb0a8aa19a1af lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756367.984582:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756367.984671:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210100480 00000100:00100000:1.0:1782756367.984681:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210100480 00010000:00010000:1.0:1782756367.984722:0:14258:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a14d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce379 expref: 14 pid: 14272 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756367.984766:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 12 00000100:00100000:1.0:1782756367.984776:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43614000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+14:2355:x1869355210100480:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782756367.984791:0:14258:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782756367.984797:0:14258:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a14d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce379 expref: 14 pid: 14272 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.984825:0:14258:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a14d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce379 expref: 14 pid: 14272 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.984847:0:14258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a14d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce379 expref: 14 pid: 14272 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.984865:0:14258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d3c58212100) 00010000:00010000:1.0:1782756367.984871:0:14258:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d400/0x5e4fb0a8aa19a1af lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.984881:0:14258:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d400/0x5e4fb0a8aa19a1af lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.984889:0:14258:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d400/0x5e4fb0a8aa19a1af lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756367.984954:0:14258:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782756367.985036:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43614000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+13:2355:x1869355210100480:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 260us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756367.985044:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 12 00010000:00010000:2.0:1782756367.993609:0:14272:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d400/0x5e4fb0a8aa19a1af lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.993627:0:14272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d400/0x5e4fb0a8aa19a1af lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756367.993657:0:14272:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1782756367.993851:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19a1a8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce39c expref: 14 pid: 14272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.993885:0:14272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d400/0x5e4fb0a8aa19a1af lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce39c expref: 13 pid: 14272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756367.993894:0:14272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d3c58212100) 00010000:00010000:2.0:1782756367.993897:0:14272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782756367.993901:0:14272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63d400, rc 0) 00000100:00100000:2.0:1782756367.994035:0:14272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+13:14444:x1869355210100224:12345-192.168.204.25@tcp:101:dd.0 Request processed in 30527us (30751us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1782756367.994044:0:14272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 34 00000100:00100000:0.0:1782756368.010340:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756368.010455:0:15590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210100736 00000100:00100000:2.0:1782756368.010466:0:15590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210100736 00000100:00100000:2.0:1782756368.010577:0:15590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 35 00000100:00100000:2.0:1782756368.010588:0:15590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43615500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+13:14444:x1869355210100736:12345-192.168.204.25@tcp:36:dd.0 00010000:00010000:2.0:1782756368.010850:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19a1bd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.010868:0:15590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19a1bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.010880:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19a1bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782756368.010995:0:15590:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1782756368.011032:0:15590:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000736010f reply state 000000007dd5809b transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19a1bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756368.011042:0:15590:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00080000:3.0:1782756368.011172:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782756368.011320:0:15590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43615500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+16:14444:x1869355210100736:12345-192.168.204.25@tcp:36:dd.0 Request processed in 732us (987us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1782756368.011328:0:15590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 35 00000020:00080000:2.0:1782756368.011333:0:15590:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1782756368.014248:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756368.014445:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210100864 00000100:00100000:3.0:1782756368.014455:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210100864 00000100:00100000:3.0:1782756368.014514:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 36 00000100:00100000:3.0:1782756368.014530:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+16:14444:x1869355210100864:12345-192.168.204.25@tcp:101:dd.0 00010000:00010000:3.0:1782756368.014553:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756368.014574:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c48257c00/0x5e4fb0a8aa19a1c4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce3a3 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.014626:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c48257c00/0x5e4fb0a8aa19a1c4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3a3 expref: 17 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.014637:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c48257c00/0x5e4fb0a8aa19a1c4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3a3 expref: 17 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.014651:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d3c58212100) 00010000:00010000:3.0:1782756368.014665:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782756368.014668:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c48257c00, rc 0) 00000100:00100000:3.0:1782756368.014709:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+17:14444:x1869355210100864:12345-192.168.204.25@tcp:101:dd.0 Request processed in 183us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756368.014715:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 36 00010000:00010000:1.0:1782756368.015958:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19a1bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.015973:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19a1bd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.015982:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19a1bd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.016005:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63cc00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756368.016011:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19a1bd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.016019:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19a1bd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.016033:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d3c58212100) 00010000:00010000:1.0:1782756368.016037:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782756368.016041:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19a1bd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.016048:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63cc00/0x5e4fb0a8aa19a1bd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756368.029513:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756368.029622:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210101120 00000100:00100000:3.0:1782756368.029633:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210101120 00000100:00100000:3.0:1782756368.029701:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 2 00000100:00100000:3.0:1782756368.029711:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43617b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+16:14444:x1869355210101120:12345-192.168.204.25@tcp:103:dd.0 00010000:00010000:3.0:1782756368.029728:0:14257:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756368.029752:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c48257c00/0x5e4fb0a8aa19a1c4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3a3 expref: 16 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.029772:0:14257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d3c58212100) 00010000:00010000:3.0:1782756368.029778:0:14257:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782756368.029880:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43617b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+15:14444:x1869355210101120:12345-192.168.204.25@tcp:103:dd.0 Request processed in 170us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756368.029888:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 2 00000100:00100000:0.0:1782756368.031372:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756368.031421:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210101248 00000100:00100000:1.0:1782756368.031428:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210101248 00000100:00100000:1.0:1782756368.031475:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 37 00000100:00100000:1.0:1782756368.031484:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+15:14444:x1869355210101248:12345-192.168.204.25@tcp:58:dd.0 00010000:00010000:1.0:1782756368.031586:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a1cb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.031602:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a1cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.031613:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a1cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782756368.032222:0:14273:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782756368.032573:0:14273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1782756368.032643:0:14273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1782756368.032813:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+15:14444:x1869355210101248:12345-192.168.204.25@tcp:58:dd.0 Request processed in 1328us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756368.032822:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 37 00000100:00100000:2.0:1782756368.034678:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756368.034733:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210101376 00000100:00100000:3.0:1782756368.034741:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210101376 00000100:00100000:3.0:1782756368.034784:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 38 00000100:00100000:3.0:1782756368.034794:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+15:14444:x1869355210101376:12345-192.168.204.25@tcp:101:dd.0 00010000:00010000:3.0:1782756368.034814:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782756368.034833:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c48257200/0x5e4fb0a8aa19a1d2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce3aa expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.034883:0:14274:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a1cb lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.034902:0:14274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c48257200/0x5e4fb0a8aa19a1d2 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3aa expref: 16 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.034918:0:14274:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a1cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.034986:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c48257200/0x5e4fb0a8aa19a1d2 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3aa expref: 16 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.034998:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d3c58212100) 00010000:00010000:3.0:1782756368.035000:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782756368.035003:0:14274:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c48257200/0x5e4fb0a8aa19a1d2 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3aa expref: 16 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.035009:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c48257200, rc 0) 00000100:00100000:3.0:1782756368.035107:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+16:14444:x1869355210101376:12345-192.168.204.25@tcp:101:dd.0 Request processed in 314us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756368.035114:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 38 00010000:00010000:2.0:1782756368.462019:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782756368.716916:0:14307:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1782756368.716927:0:14307:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782756368.716991:0:14307:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1782756368.717000:0:14307:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1782756368.717180:0:14307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c770fed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14307:1869355222662144:192.168.204.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782756368.717348:0:14307:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c48cc9540 going to sleep for 11 seconds 00000100:00100000:1.0:1782756368.724622:0:14307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c770fed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14307:1869355222662144:192.168.204.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782756368.725103:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756368.725452:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210101504 00000100:00100000:1.0:1782756368.725460:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210101504 00000100:00100000:1.0:1782756368.725717:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 0 00000100:00100000:1.0:1782756368.725729:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+16:14445:x1869355210101504:12345-192.168.204.25@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1782756368.725822:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+16:14445:x1869355210101504:12345-192.168.204.25@tcp:900:lhsmtool_posix.0 Request processed in 94us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756368.726682:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 0 00000100:00100000:2.0:1782756368.727951:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756368.728045:0:15590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210101632 00000100:00100000:1.0:1782756368.728053:0:15590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210101632 00000100:00100000:1.0:1782756368.728293:0:15590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 39 00000100:00100000:1.0:1782756368.728303:0:15590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+16:14445:x1869355210101632:12345-192.168.204.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782756368.728336:0:15590:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782756368.728916:0:15590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+16:14445:x1869355210101632:12345-192.168.204.25@tcp:53:lhsmtool_posix.0 Request processed in 613us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756368.728924:0:15590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 39 00000100:00100000:2.0:1782756368.740389:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756368.746370:0:14272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210101760 00000100:00100000:0.0:1782756368.746395:0:14272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210101760 00000100:00100000:0.0:1782756368.746493:0:14272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 40 00000100:00100000:0.0:1782756368.746752:0:14272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+16:14445:x1869355210101760:12345-192.168.204.25@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1782756368.746861:0:14272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16600/0x5e4fb0a8aa19a1d9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.746883:0:14272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16600/0x5e4fb0a8aa19a1d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.746897:0:14272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16600/0x5e4fb0a8aa19a1d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.750087:0:14272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17200/0x5e4fb0a8aa19a1e0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.750116:0:14272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17200/0x5e4fb0a8aa19a1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.750149:0:14272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17200/0x5e4fb0a8aa19a1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.750187:0:14272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa19a1e7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.750197:0:14272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa19a1e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.750204:0:14272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa19a1e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782756368.750263:0:14272:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1782756368.750268:0:14272:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782756368.750287:0:14272:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa19a1e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.750299:0:14272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16600/0x5e4fb0a8aa19a1d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.750306:0:14272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16600/0x5e4fb0a8aa19a1d9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.750313:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16600/0x5e4fb0a8aa19a1d9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.750319:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c76e16600 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756368.750323:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16600/0x5e4fb0a8aa19a1d9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.750329:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16600/0x5e4fb0a8aa19a1d9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.750349:0:14272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3c49e15800) 00010000:00010000:0.0:1782756368.750353:0:14272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756368.750358:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16600/0x5e4fb0a8aa19a1d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.750364:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e16600/0x5e4fb0a8aa19a1d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.750381:0:14272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17200/0x5e4fb0a8aa19a1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.750387:0:14272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17200/0x5e4fb0a8aa19a1e0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.750393:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17200/0x5e4fb0a8aa19a1e0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.750398:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c76e17200 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756368.750401:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17200/0x5e4fb0a8aa19a1e0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.750408:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17200/0x5e4fb0a8aa19a1e0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.750416:0:14272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9d3c54288600) 00010000:00010000:0.0:1782756368.750418:0:14272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756368.750421:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17200/0x5e4fb0a8aa19a1e0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.750427:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17200/0x5e4fb0a8aa19a1e0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.750477:0:14272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa19a1e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.750484:0:14272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa19a1e7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.750491:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa19a1e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.750498:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c76e17000 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:0.0:1782756368.750502:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa19a1e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.750508:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa19a1e7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.750517:0:14272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d3c58212100) 00010000:00010000:0.0:1782756368.750520:0:14272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782756368.750522:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa19a1e7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.750528:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c76e17000/0x5e4fb0a8aa19a1e7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756368.750708:0:14272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+16:14445:x1869355210101760:12345-192.168.204.25@tcp:34:lhsmtool_posix.0 Request processed in 4199us (10329us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756368.750721:0:14272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 40 00000100:00100000:0.0:1782756368.759874:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756368.759947:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210102016 00000100:00100000:2.0:1782756368.759958:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210102016 00000100:00100000:2.0:1782756368.760028:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 41 00000100:00100000:2.0:1782756368.760040:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+16:14445:x1869355210102016:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782756368.760064:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756368.760111:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a1ee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce3b1 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.760209:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a1f5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.760239:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.760248:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756368.760258:0:14273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1782756368.760345:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.760353:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a1f5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.760372:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a1f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.760379:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d800 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756368.760383:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a1f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.760391:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a1f5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.760400:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d3c58212100) 00010000:00010000:2.0:1782756368.760403:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782756368.760406:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a1f5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.760410:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a1f5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.760444:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a1ee lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3b1 expref: 18 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.760451:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d3c49e15800) 00010000:00010000:2.0:1782756368.760452:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782756368.760455:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d000/0x5e4fb0a8aa19a1ee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3b1 expref: 18 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.760460:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63d000, rc 0) 00000100:00100000:2.0:1782756368.760510:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+17:14445:x1869355210102016:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 474us (650us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1782756368.760526:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 41 00000100:00100000:2.0:1782756368.768317:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756368.769417:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210102144 00000100:00100000:3.0:1782756368.769453:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210102144 00000100:00100000:3.0:1782756368.769604:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 42 00000100:00100000:3.0:1782756368.769622:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+17:14445:x1869355210102144:12345-192.168.204.25@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782756368.769698:0:14274:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782756368.769922:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+17:14445:x1869355210102144:12345-192.168.204.25@tcp:53:lhsmtool_posix.0 Request processed in 304us (1613us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756368.769934:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 42 00000100:00100000:0.0:1782756368.779120:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756368.779172:0:15590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210102400 00000100:00100000:1.0:1782756368.779182:0:15590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210102400 00000100:00100000:1.0:1782756368.779256:0:15590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 43 00000100:00100000:1.0:1782756368.779266:0:15590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+17:14445:x1869355210102400:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782756368.779289:0:15590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756368.779308:0:15590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa19a203 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce3b8 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782756368.780198:0:15590:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:1.0:1782756368.780208:0:15590:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1782756368.780275:0:15590:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1782756368.780619:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a20a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.780635:0:15590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a20a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.780647:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a20a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15590 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.780708:0:15590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa19a203 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3b8 expref: 20 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.780727:0:15590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a20a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3b8 expref: 19 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.780735:0:15590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d3c49e15500) 00010000:00010000:1.0:1782756368.780738:0:15590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782756368.780742:0:15590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41497e00, rc 0) 00000100:00100000:1.0:1782756368.780819:0:15590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+19:14445:x1869355210102400:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 1553us (1753us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1782756368.780829:0:15590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 43 00000100:00100000:0.0:1782756368.786031:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756368.786264:0:14272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210102656 00000100:00100000:2.0:1782756368.786275:0:14272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210102656 00000100:00100000:2.0:1782756368.786361:0:14272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 44 00000100:00100000:2.0:1782756368.786370:0:14272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+19:14445:x1869355210102656:12345-192.168.204.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782756368.786437:0:14272:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756368.786462:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497e00/0x5e4fb0a8aa19a20a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3b8 expref: 19 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.786479:0:14272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d3c49e15500) 00010000:00010000:2.0:1782756368.786488:0:14272:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782756368.786506:0:14272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a218 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.786517:0:14272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a218 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.786531:0:14272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a218 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.786559:0:14272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa19a21f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe08b4d24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.786565:0:14272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa19a21f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe08b4d24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.786569:0:14272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa19a21f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe08b4d24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.786883:0:14272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a218 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.786891:0:14272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a218 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.786898:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a218 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.786904:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d800 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756368.786908:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a218 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.786916:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a218 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.786925:0:14272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d3c49e15b00) 00010000:00010000:2.0:1782756368.786928:0:14272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756368.786932:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a218 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.786937:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a218 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.786947:0:14272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa19a21f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe08b4d24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.786953:0:14272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa19a21f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe08b4d24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.786958:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa19a21f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe08b4d24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.786969:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63c600 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756368.786972:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa19a21f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe08b4d24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.786978:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa19a21f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe08b4d24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.786987:0:14272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xe08b4d24 (ffff9d3c58212d00) 00010000:00010000:2.0:1782756368.786989:0:14272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756368.786992:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa19a21f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe08b4d24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.786998:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa19a21f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe08b4d24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756368.787117:0:14272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+18:14445:x1869355210102656:12345-192.168.204.25@tcp:36:lhsmtool_posix.0 Request processed in 747us (1098us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782756368.787124:0:14272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 44 00000100:00100000:2.0:1782756368.789400:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756368.789473:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210102784 00000100:00100000:1.0:1782756368.789482:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210102784 00000100:00100000:1.0:1782756368.789542:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 45 00000100:00100000:1.0:1782756368.789655:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+18:14445:x1869355210102784:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782756368.789675:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782756368.789698:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa19a226 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce3bf expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.789733:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a22d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.789746:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a22d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.789756:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a22d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.789851:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa19a226 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3bf expref: 20 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.789870:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496800/0x5e4fb0a8aa19a22d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3bf expref: 19 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.789879:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d3c49e15000) 00010000:00010000:1.0:1782756368.789883:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782756368.789904:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c41496800, rc 0) 00000100:00100000:1.0:1782756368.789950:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+19:14445:x1869355210102784:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 400us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756368.789957:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 45 00000100:00100000:0.0:1782756368.793388:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756368.793443:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210103040 00000100:00100000:3.0:1782756368.793456:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210103040 00000100:00100000:3.0:1782756368.793519:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 46 00000100:00100000:3.0:1782756368.793528:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+19:14445:x1869355210103040:12345-192.168.204.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782756368.793613:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c48257c00/0x5e4fb0a8aa19a234 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.793628:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c48257c00/0x5e4fb0a8aa19a234 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.793640:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c48257c00/0x5e4fb0a8aa19a234 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782756368.794174:0:14274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1782756368.794188:0:14274:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 410029111883ns, next at 411029108499ns, rc = 0 00000004:00010000:3.0:1782756368.794319:0:14274:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001ba4127d reply state 00000000a3ee3876 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c48257c00/0x5e4fb0a8aa19a234 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756368.794331:0:14274:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782756368.794658:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+21:14445:x1869355210103040:12345-192.168.204.25@tcp:36:lhsmtool_posix.0 Request processed in 1128us (1276us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1782756368.794667:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 46 00010000:00010000:3.0:1782756368.798027:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c48257c00/0x5e4fb0a8aa19a234 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.798047:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c48257c00/0x5e4fb0a8aa19a234 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.798055:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c48257c00/0x5e4fb0a8aa19a234 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.798061:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c48257c00 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:3.0:1782756368.798066:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c48257c00/0x5e4fb0a8aa19a234 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.798316:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c48257c00/0x5e4fb0a8aa19a234 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.798347:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d3c49e15000) 00010000:00010000:3.0:1782756368.798351:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782756368.798358:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c48257c00/0x5e4fb0a8aa19a234 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.798364:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c48257c00/0x5e4fb0a8aa19a234 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756368.802595:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756368.803412:0:15590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210103168 00000100:00100000:2.0:1782756368.803438:0:15590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210103168 00000100:00100000:2.0:1782756368.803523:0:15590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 47 00000100:00100000:2.0:1782756368.803632:0:15590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+20:14445:x1869355210103168:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782756368.803664:0:15590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756368.803706:0:15590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa19a23b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce3c6 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.803767:0:15590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa19a23b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3c6 expref: 21 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.803783:0:15590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa19a23b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3c6 expref: 21 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.803802:0:15590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d3c49e15000) 00010000:00010000:2.0:1782756368.803805:0:15590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782756368.803810:0:15590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63c600, rc 0) 00000100:00100000:2.0:1782756368.803874:0:15590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+21:14445:x1869355210103168:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 244us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756368.804653:0:15590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 47 00000100:00100000:0.0:1782756368.808562:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756368.810462:0:14911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210103296 00000100:00100000:2.0:1782756368.810484:0:14911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210103296 00000100:00080000:3.0:1782756368.810598:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782756368.810638:0:14911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13 00000100:00100000:2.0:1782756368.810655:0:14911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b43616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+5:2356:x1869355210103296:12345-192.168.204.25@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1782756368.811352:0:14911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b43616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+6:2356:x1869355210103296:12345-192.168.204.25@tcp:2:lhsmtool_posix.0 Request processed in 702us (2802us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1782756368.811362:0:14911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13 00000100:00100000:3.0:1782756368.814782:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756368.815289:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210103552 00000100:00100000:0.0:1782756368.815299:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210103552 00000100:00100000:0.0:1782756368.815406:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9 00000100:00100000:0.0:1782756368.815418:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+21:14445:x1869355210103552:12345-192.168.204.25@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1782756368.815691:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+22:14445:x1869355210103552:12345-192.168.204.25@tcp:35:lhsmtool_posix.0 Request processed in 274us (918us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1782756368.815700:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9 00000100:00100000:0.0:1782756368.819666:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756368.819739:0:14272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210103808 00000100:00100000:2.0:1782756368.819751:0:14272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210103808 00000100:00100000:2.0:1782756368.819823:0:14272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 48 00000100:00100000:2.0:1782756368.819836:0:14272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+22:14445:x1869355210103808:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782756368.819959:0:14272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+22:14445:x1869355210103808:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 Request processed in 126us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756368.819979:0:14272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 48 00000100:00100000:1.0:1782756368.821930:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756368.822243:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210103936 00000100:00100000:2.0:1782756368.822253:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210103936 00000100:00100000:2.0:1782756368.822309:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 49 00000100:00100000:2.0:1782756368.822319:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+22:14445:x1869355210103936:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782756368.822338:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782756368.822362:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a242 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce3cd expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.822430:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a249 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.822444:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a249 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.822454:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a249 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782756368.822489:0:14273:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782756368.822506:0:14273:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a249 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.822709:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d800/0x5e4fb0a8aa19a242 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3cd expref: 24 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.822730:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a249 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3cd expref: 23 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.822739:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d3c49e15000) 00010000:00010000:2.0:1782756368.822755:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1782756368.822760:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c4a63c000, rc 0) 00000100:00100000:2.0:1782756368.822819:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+23:14445:x1869355210103936:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 501us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756368.822826:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 49 00000100:00100000:3.0:1782756368.825419:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756368.825570:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210104064 00000100:00100000:0.0:1782756368.825580:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210104064 00000100:00100000:0.0:1782756368.825626:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14 00000100:00100000:0.0:1782756368.825633:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+6:2355:x1869355210104064:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782756368.825647:0:14910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756368.825664:0:14910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbb489af/0x5e4fb0a8aa19a250 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce3d4 expref: -99 pid: 14910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782756368.825683:0:14910:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a42b410, blocks: 0x1 00010000:00010000:0.0:1782756368.825698:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1782756368.825702:0:14910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782756368.825708:0:14910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbb489af/0x5e4fb0a8aa19a250 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3d4 expref: 7 pid: 14910 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.825722:0:14910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bbb489af/0x5e4fb0a8aa19a250 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3d4 expref: 7 pid: 14910 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.825744:0:14910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c76e17c00, rc 0) 00000100:00100000:0.0:1782756368.825789:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+7:2355:x1869355210104064:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 156us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756368.825794:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14 00000100:00100000:0.0:1782756368.827958:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756368.828032:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210104320 00000100:00100000:1.0:1782756368.828040:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210104320 00000100:00100000:1.0:1782756368.828108:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 50 00000100:00100000:1.0:1782756368.828117:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+23:14445:x1869355210104320:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1782756368.828223:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+23:14445:x1869355210104320:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 Request processed in 98us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756368.828231:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 50 00000100:00100000:1.0:1782756368.829679:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756368.829874:0:15590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210104448 00000100:00100000:2.0:1782756368.829881:0:15590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210104448 00000100:00100000:2.0:1782756368.830307:0:15590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 51 00000100:00100000:2.0:1782756368.830317:0:15590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+23:14445:x1869355210104448:12345-192.168.204.25@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1782756368.845179:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c770fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222662272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782756368.845285:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782756368.845363:0:14914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222662272 00000100:00100000:3.0:1782756368.845373:0:14914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222662272 00000100:00100000:3.0:1782756368.845437:0:14914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782756368.845448:0:14914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222662272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782756368.845500:0:14914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782756368.845547:0:14914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222662272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756368.845555:0:14914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1782756368.845580:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782756368.845623:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c770fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222662272:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1782756368.859414:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1782756368.859454:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1782756368.859522:0:15590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+14:14445:x1869355210104448:12345-192.168.204.25@tcp:44:lhsmtool_posix.0 Request processed in 29200us (29839us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756368.859535:0:15590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 51 00000100:00100000:1.0:1782756368.860024:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782756368.860041:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222662400:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1782756368.860128:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756368.860298:0:14912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222662400 00000100:00100000:0.0:1782756368.860305:0:14912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222662400 00000100:00100000:0.0:1782756368.860377:0:14912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1782756368.860381:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782756368.860390:0:14912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222662400:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1782756368.860536:0:14912:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1782756368.860539:0:14912:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1782756368.860540:0:14912:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1782756368.860542:0:14912:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1782756368 -> 1782756368 00002000:00010000:0.0:1782756368.860543:0:14912:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1782756368.860577:0:14912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3317:x1869355222662400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 191us (461us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1782756368.860583:0:14912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1782756368.860679:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d3c6a33d180/2, rc 0, transno 8589934595 00000100:00100000:1.0:1782756368.860686:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222662400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1782756368.861819:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756368.861908:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210104576 00000100:00100000:3.0:1782756368.861914:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210104576 00000100:00100000:3.0:1782756368.861993:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16 00000100:00100000:3.0:1782756368.862003:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77043b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+7:2358:x1869355210104576:12345-192.168.204.25@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1782756368.862473:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77043b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+7:2358:x1869355210104576:12345-192.168.204.25@tcp:16:lhsmtool_posix.0 Request processed in 470us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756368.862481:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16 00000100:00100000:0.0:1782756368.864462:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756368.864529:0:14272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210104832 00000100:00100000:2.0:1782756368.864538:0:14272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210104832 00000100:00100000:2.0:1782756368.864600:0:14272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 52 00000100:00100000:2.0:1782756368.864608:0:14272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+14:14445:x1869355210104832:12345-192.168.204.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782756368.864667:0:14272:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782756368.864696:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a249 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3cd expref: 14 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.864716:0:14272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d3c49e15000) 00010000:00010000:2.0:1782756368.864721:0:14272:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782756368.864757:0:14272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a257 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.864772:0:14272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a257 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.864781:0:14272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a257 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782756368.865010:0:14272:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002b7f6149 reply state 000000001db8a28e transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a257 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756368.865037:0:14272:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782756368.865282:0:14272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+15:14445:x1869355210104832:12345-192.168.204.25@tcp:36:lhsmtool_posix.0 Request processed in 673us (825us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1782756368.865290:0:14272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 52 00000100:00100000:1.0:1782756368.868552:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1782756368.868628:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a257 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.868643:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a257 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.868652:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a257 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.868658:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d600 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756368.868664:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a257 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.868672:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a257 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.868689:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d3c49e15000) 00010000:00010000:2.0:1782756368.868692:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756368.868697:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a257 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.868703:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a257 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14272 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756368.869507:0:14912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210104960 00000100:00100000:0.0:1782756368.869518:0:14912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210104960 00000100:00100000:0.0:1782756368.869580:0:14912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17 00000100:00100000:0.0:1782756368.869589:0:14912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c770fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+7:14445:x1869355210104960:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782756368.869631:0:14912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782756368.869649:0:14912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000678b576d/0x5e4fb0a8aa19a25e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1ac1ee7c1a6ce3db expref: -99 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.869680:0:14912:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bbb489af/0x5e4fb0a8aa19a250 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3d4 expref: 8 pid: 14910 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.869689:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782756368.869694:0:14912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782756368.869699:0:14912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000678b576d/0x5e4fb0a8aa19a25e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3db expref: 8 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.869734:0:14912:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bbb489af/0x5e4fb0a8aa19a250 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3d4 expref: 8 pid: 14910 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756368.869750:0:14912:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bbb489af/0x5e4fb0a8aa19a250 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3d4 expref: 8 pid: 14910 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756368.869764:0:14912:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c77040a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14912:1869355222662528:192.168.204.25@tcp:104: 00000100:00100000:0.0:1782756368.869849:0:14912:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c48f81300 going to sleep for 11 seconds 00000100:00100000:3.0:1782756368.875199:0:14912:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c77040a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14912:1869355222662528:192.168.204.25@tcp:104: 00010000:00010000:3.0:1782756368.875258:0:14912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000678b576d/0x5e4fb0a8aa19a25e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3db expref: 8 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.875281:0:14912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d3c76e17800, rc 0) 00000100:00100000:3.0:1782756368.875343:0:14912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c770fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+8:14445:x1869355210104960:12345-192.168.204.25@tcp:101:lhsmtool_posix.0 Request processed in 5753us (6799us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756368.875352:0:14912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17 00000100:00100000:1.0:1782756368.876919:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756368.877064:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210105088 00000100:00100000:3.0:1782756368.877135:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210105088 00010000:00010000:3.0:1782756368.877177:0:14259:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bbb489af/0x5e4fb0a8aa19a250 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3d4 expref: 8 pid: 14910 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756368.877343:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 13 00000100:00100000:3.0:1782756368.877355:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+8:2355:x1869355210105088:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782756368.877371:0:14259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756368.877399:0:14259:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bbb489af/0x5e4fb0a8aa19a250 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3d4 expref: 8 pid: 14910 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.877438:0:14259:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bbb489af/0x5e4fb0a8aa19a250 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3d4 expref: 8 pid: 14910 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.877462:0:14259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbb489af/0x5e4fb0a8aa19a250 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3d4 expref: 8 pid: 14910 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.877480:0:14259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756368.877485:0:14259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756368.877491:0:14259:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000678b576d/0x5e4fb0a8aa19a25e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3db expref: 7 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.877501:0:14259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000678b576d/0x5e4fb0a8aa19a25e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3db expref: 7 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.877542:0:14259:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000678b576d/0x5e4fb0a8aa19a25e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3db expref: 7 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756368.877557:0:14259:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e11c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14259:1869355222662656:192.168.204.25@tcp:105: 00000100:00100000:3.0:1782756368.877662:0:14259:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c43f486c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782756368.880891:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756368.881394:0:14259:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e11c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14259:1869355222662656:192.168.204.25@tcp:105: 00010000:00010000:3.0:1782756368.881418:0:14259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782756368.881473:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+7:2355:x1869355210105088:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4121us (4561us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756368.881504:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 13 00000100:00100000:2.0:1782756368.882046:0:16051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210105216 00000100:00100000:2.0:1782756368.882053:0:16051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210105216 00000100:00100000:2.0:1782756368.882116:0:16051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18 00000100:00100000:2.0:1782756368.882125:0:16051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+7:2356:x1869355210105216:12345-192.168.204.25@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1782756368.882365:0:16051:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782756368.882369:0:16051:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1782756367 00002000:00010000:2.0:1782756368.882372:0:16051:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1782756366 00002000:00010000:2.0:1782756368.882374:0:16051:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1782756368 -> 1782756367 00002000:00010000:2.0:1782756368.882376:0:16051:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1782756368.882471:0:16051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+8:2356:x1869355210105216:12345-192.168.204.25@tcp:2:lhsmtool_posix.0 Request processed in 346us (1588us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1782756368.882478:0:16051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18 00000100:00100000:1.0:1782756368.887774:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756368.888159:0:14911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210105344 00000100:00100000:2.0:1782756368.888172:0:14911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210105344 00000100:00100000:2.0:1782756368.888240:0:14911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19 00000100:00100000:2.0:1782756368.888252:0:14911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+8:2357:x1869355210105344:12345-192.168.204.25@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1782756368.888308:0:14911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000039e849a7/0x5e4fb0a8aa19a265 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.888330:0:14911:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000678b576d/0x5e4fb0a8aa19a25e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3db expref: 8 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.888339:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782756368.888343:0:14911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782756368.888348:0:14911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039e849a7/0x5e4fb0a8aa19a265 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.888381:0:14911:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000678b576d/0x5e4fb0a8aa19a25e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3db expref: 8 pid: 14912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.888410:0:14911:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000678b576d/0x5e4fb0a8aa19a25e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3db expref: 8 pid: 14912 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756368.888425:0:14911:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14911:1869355222662784:192.168.204.25@tcp:104: 00000100:00100000:2.0:1782756368.888913:0:14911:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c50115300 going to sleep for 11 seconds 00000100:00100000:2.0:1782756368.894454:0:14911:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14911:1869355222662784:192.168.204.25@tcp:104: 00010000:00010000:2.0:1782756368.894503:0:14911:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000039e849a7/0x5e4fb0a8aa19a265 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756368.894921:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756368.895008:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210105472 00000100:00100000:3.0:1782756368.895018:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210105472 00010000:00010000:3.0:1782756368.895065:0:14257:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000678b576d/0x5e4fb0a8aa19a25e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3db expref: 9 pid: 14912 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756368.895143:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 14 00000100:00100000:3.0:1782756368.895155:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+9:2355:x1869355210105472:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782756368.895188:0:14257:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756368.895419:0:14257:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000678b576d/0x5e4fb0a8aa19a25e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3db expref: 9 pid: 14912 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.895436:0:14257:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000678b576d/0x5e4fb0a8aa19a25e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3db expref: 9 pid: 14912 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.895467:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000678b576d/0x5e4fb0a8aa19a25e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3db expref: 9 pid: 14912 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.895489:0:14257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782756368.895495:0:14257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782756368.895501:0:14257:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000039e849a7/0x5e4fb0a8aa19a265 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.895512:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039e849a7/0x5e4fb0a8aa19a265 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.895561:0:14257:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782756368.895727:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+8:2355:x1869355210105472:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 572us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756368.895735:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 14 00010000:00010000:2.0:1782756368.896131:0:14911:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000039e849a7/0x5e4fb0a8aa19a265 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.896142:0:14911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039e849a7/0x5e4fb0a8aa19a265 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.896181:0:14911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000039e849a7/0x5e4fb0a8aa19a265 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.896190:0:14911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039e849a7/0x5e4fb0a8aa19a265 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.896197:0:14911:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039e849a7/0x5e4fb0a8aa19a265 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.896230:0:14911:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d600 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:2.0:1782756368.896235:0:14911:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039e849a7/0x5e4fb0a8aa19a265 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.896245:0:14911:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039e849a7/0x5e4fb0a8aa19a265 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.896261:0:14911:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039e849a7/0x5e4fb0a8aa19a265 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.896268:0:14911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039e849a7/0x5e4fb0a8aa19a265 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756368.896343:0:14911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+7:2357:x1869355210105344:12345-192.168.204.25@tcp:1:lhsmtool_posix.0 Request processed in 8093us (8578us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756368.896352:0:14911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19 00000100:00100000:0.0:1782756368.900762:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756368.900960:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210105728 00000100:00100000:1.0:1782756368.900974:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210105728 00000100:00100000:1.0:1782756368.901296:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 53 00000100:00100000:1.0:1782756368.901308:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+14:14445:x1869355210105728:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1782756368.901417:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa19a26c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.901440:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa19a26c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.901454:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa19a26c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.901784:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a273 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.901798:0:14273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa19a23b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3c6 expref: 15 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.901808:0:14273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a273 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.901852:0:14273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa19a23b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3c6 expref: 15 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.901869:0:14273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa19a23b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3c6 expref: 15 pid: 15590 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756368.901885:0:14273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb9ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14273:1869355222662912:192.168.204.25@tcp:104: 00000100:00100000:1.0:1782756368.901989:0:14273:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76f31840 going to sleep for 11 seconds 00000100:00100000:0.0:1782756368.904551:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756368.904566:0:14273:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb9ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14273:1869355222662912:192.168.204.25@tcp:104: 00010000:00010000:1.0:1782756368.904603:0:14273:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a273 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756368.904622:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210105856 00000100:00100000:3.0:1782756368.904631:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210105856 00010000:00010000:3.0:1782756368.904671:0:14259:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa19a23b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3c6 expref: 16 pid: 15590 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756368.904713:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15 00000100:00100000:3.0:1782756368.904724:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77043100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+16:2355:x1869355210105856:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782756368.904741:0:14259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782756368.904749:0:14259:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa19a23b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3c6 expref: 16 pid: 15590 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.904761:0:14259:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa19a23b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3c6 expref: 16 pid: 15590 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.904787:0:14259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c600/0x5e4fb0a8aa19a23b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3c6 expref: 16 pid: 15590 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.904805:0:14259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d3c49e15000) 00010000:00010000:3.0:1782756368.904808:0:14259:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a273 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.904816:0:14259:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a273 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.904837:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a273 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.904858:0:14259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782756368.904879:0:14273:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a273 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.904885:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a273 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756368.904927:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77043100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+15:2355:x1869355210105856:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 204us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756368.904935:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15 00000001:00080000:1.0:1782756368.905124:0:14273:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1782756368.905307:0:14273:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1782756368.905370:0:14273:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1782756368.905486:0:14273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb9ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14273:1869355222663040:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1782756368.905580:0:14273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756368.905628:0:14273:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76f31c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782756368.905706:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222663040 00000100:00100000:3.0:1782756368.905712:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222663040 00000100:00100000:3.0:1782756368.905747:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782756368.905757:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14273:x1869355222663040:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782756368.905888:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14273:x1869355222663040:12345-0@lo:1000:mdt00_001.0 Request processed in 132us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756368.905895:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782756368.906027:0:14273:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb9ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14273:1869355222663040:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1782756368.906915:0:14273:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1782756368.907009:0:14273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb9ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14273:1869355222663168:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1782756368.907058:0:14273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756368.907166:0:14273:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c76f31840 going to sleep for 11 seconds 00000100:00100000:0.0:1782756368.907231:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222663168 00000100:00100000:0.0:1782756368.907239:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222663168 00000100:00100000:0.0:1782756368.907281:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782756368.907296:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14273:x1869355222663168:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782756368.907519:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14273:x1869355222663168:12345-0@lo:1000:mdt00_001.0 Request processed in 223us (458us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1782756368.907532:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782756368.907613:0:14273:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb9ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14273:1869355222663168:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1782756368.907660:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a273 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.907673:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a273 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.907681:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a273 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.907698:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41496600 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756368.907704:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a273 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.907713:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a273 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.907867:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d3c49e15000) 00010000:00010000:1.0:1782756368.907872:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782756368.907880:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a273 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.907887:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496600/0x5e4fb0a8aa19a273 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.907947:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a1cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.907953:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a1cb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.907959:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a1cb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.907964:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41496400 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:1.0:1782756368.907968:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a1cb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.907975:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a1cb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.908007:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d3c58212100) 00010000:00010000:1.0:1782756368.908009:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782756368.908019:0:14273:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c48257200/0x5e4fb0a8aa19a1d2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3aa expref: 18 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.908032:0:14273:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c48257200/0x5e4fb0a8aa19a1d2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3aa expref: 18 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756368.908044:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c48257200/0x5e4fb0a8aa19a1d2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3aa expref: 18 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.908244:0:14273:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c48257200/0x5e4fb0a8aa19a1d2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0x1ac1ee7c1a6ce3aa expref: 18 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756368.908262:0:14273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c6a33dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14273:1869355222663296:192.168.204.25@tcp:105: 00000100:00100000:2.0:1782756368.908395:0:14273:0:(client.c:2701:ptlrpc_set_wait()) set ffff9d3c50115300 going to sleep for 11 seconds 00000100:00100000:2.0:1782756368.911853:0:14273:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c6a33dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14273:1869355222663296:192.168.204.25@tcp:105: 00010000:00010000:2.0:1782756368.911902:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a1cb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.911938:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41496400/0x5e4fb0a8aa19a1cb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.911987:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a27a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.912003:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a27a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.912015:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a27a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.912026:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a27a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.912034:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a27a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.912041:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a27a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.912047:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63d600 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756368.912051:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a27a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.912059:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a27a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.912476:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d3c58212100) 00010000:00010000:2.0:1782756368.912482:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782756368.912486:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a27a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.912501:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63d600/0x5e4fb0a8aa19a27a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.912516:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa19a26c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.912531:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa19a26c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.912538:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa19a26c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.912544:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41497400 already unused, calling callback (ffffffffc20a84f0) 00010000:00010000:2.0:1782756368.912547:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa19a26c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.912552:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa19a26c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.912560:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d3c58212100) 00010000:00010000:2.0:1782756368.912561:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782756368.912563:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa19a26c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.912567:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c41497400/0x5e4fb0a8aa19a26c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756368.912927:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+18:14445:x1869355210105728:12345-192.168.204.25@tcp:57:lhsmtool_posix.0 Request processed in 11612us (12167us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1782756368.912941:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756368.912945:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 53 00000020:00080000:2.0:1782756368.912961:0:14273:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1782756368.913044:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210105984 00000100:00100000:2.0:1782756368.913052:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210105984 00000100:00100000:2.0:1782756368.913138:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 10 00000100:00100000:2.0:1782756368.913148:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c44cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+18:14444:x1869355210105984:12345-192.168.204.25@tcp:49:dd.0 00000100:00100000:2.0:1782756368.913316:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c44cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+18:14444:x1869355210105984:12345-192.168.204.25@tcp:49:dd.0 Request processed in 169us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756368.913323:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 10 00000040:00080000:1.0:1782756368.913591:0:14307:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1782756368.913597:0:14307:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782756368.913622:0:14307:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1782756368.913628:0:14307:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1782756368.917193:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1782756368.917242:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210106240 00000100:00100000:2.0:1782756368.917253:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210106240 00000100:00100000:2.0:1782756368.917302:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 11 00000100:00100000:2.0:1782756368.917310:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+18:14445:x1869355210106240:12345-192.168.204.25@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1782756368.918173:0:14276:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1782756368.918263:0:14276:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1782756368.918298:0:14276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a281 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.918312:0:14276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a281 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.918320:0:14276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a281 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.918327:0:14276:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a281 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.918332:0:14276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a281 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.918335:0:14276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a281 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756368.918359:0:14276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782756368.918439:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+20:14445:x1869355210106240:12345-192.168.204.25@tcp:35:lhsmtool_posix.0 Request processed in 1128us (1261us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1782756368.918445:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 11 00000020:00080000:2.0:1782756368.918450:0:14276:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782756368.918770:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782756368.918778:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a281 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.918785:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c4a63c000 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756368.918789:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a281 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.918798:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a281 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.918812:0:14261:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d3c49e15000) 00010000:00010000:3.0:1782756368.918815:0:14261:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782756368.918820:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a281 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.918834:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d3c4a63c000/0x5e4fb0a8aa19a281 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756368.918846:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756368.918847:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782756368.918849:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756369.248382:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756369.248930:0:14916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210106368 00000100:00100000:1.0:1782756369.248944:0:14916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210106368 00000100:00100000:1.0:1782756369.249036:0:14916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 0 00000100:00100000:1.0:1782756369.249050:0:14916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+7:2357:x1869355210106368:12345-192.168.204.25@tcp:4:dd.0 00002000:00010000:1.0:1782756369.249156:0:14916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a42b40f, atime: 0x6a42b40e, ctime: 0x6a42b40f, blocks: 0x1 00010000:00010000:1.0:1782756369.249170:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa19a288 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.249197:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=410s v=(0 0) 00010000:00010000:1.0:1782756369.249202:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756369.249221:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa19a288 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.249267:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa19a288 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756369.265168:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756369.267228:0:14918:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1782756369.267256:0:14918:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1782756369.271420:0:14918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210106496 00000100:00100000:3.0:1782756369.271448:0:14918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210106496 00000100:00100000:1.0:1782756369.274124:0:16406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1 00000100:00100000:1.0:1782756369.274163:0:16406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+9:2357:x1869355210106496:12345-192.168.204.25@tcp:4:dd.0 00010000:00010000:1.0:1782756369.274252:0:16406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dced21c9/0x5e4fb0a8aa19a28f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.274282:0:16406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756369.274288:0:16406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756369.274299:0:16406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dced21c9/0x5e4fb0a8aa19a28f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.274320:0:16406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dced21c9/0x5e4fb0a8aa19a28f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756369.278873:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756369.278941:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756369.278975:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756369.278991:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756369.279003:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756369.279027:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1782756369.279954:0:14917:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1782756369.279976:0:14917:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1782756369.280343:0:14917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210106624 00000100:00100000:1.0:1782756369.280359:0:14917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210106624 00000100:00100000:1.0:1782756369.280448:0:14917:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1782756369.280455:0:14917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210106752 00000100:00100000:1.0:1782756369.280457:0:14917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210106752 00000100:00100000:1.0:1782756369.280468:0:14917:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1782756369.280472:0:14917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210106880 00000100:00100000:1.0:1782756369.280474:0:14917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210106880 00000100:00100000:1.0:1782756369.280484:0:14917:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1782756369.280489:0:14917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210107008 00000100:00100000:1.0:1782756369.280497:0:14917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210107008 00000100:00100000:1.0:1782756369.280509:0:14917:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1782756369.280516:0:14917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210107136 00000100:00100000:1.0:1782756369.280518:0:14917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210107136 00000100:00100000:1.0:1782756369.280592:0:14917:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1782756369.280600:0:14917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210107264 00000100:00100000:1.0:1782756369.280603:0:14917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210107264 00000100:00100000:1.0:1782756369.282426:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 2 00000100:00100000:1.0:1782756369.282449:0:16407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77040e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+16:2357:x1869355210106624:12345-192.168.204.25@tcp:4:dd.0 00010000:00010000:1.0:1782756369.282504:0:16407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d173de0e/0x5e4fb0a8aa19a296 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.282585:0:16407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756369.282592:0:16407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756369.282602:0:16407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d173de0e/0x5e4fb0a8aa19a296 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.282620:0:16407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d173de0e/0x5e4fb0a8aa19a296 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782756369.413837:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:0.0:1782756369.413865:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:1.0:1782756369.416751:0:14916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:1.0:1782756369.416766:0:14916:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1782756367 -> 1782756368 00002000:00010000:1.0:1782756369.416770:0:14916:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1782756367 -> 1782756368 00002000:00010000:1.0:1782756369.416772:0:14916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1782756369.416797:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa19a288 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.416815:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa19a288 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.416858:0:14916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa19a288 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.416866:0:14916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41496600 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:1.0:1782756369.416872:0:14916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa19a288 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.416882:0:14916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa19a288 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.416910:0:14916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa19a288 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.416919:0:14916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8751c4c/0x5e4fb0a8aa19a288 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756369.418549:0:14916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+18:2357:x1869355210106368:12345-192.168.204.25@tcp:4:dd.0 Request processed in 169485us (170163us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1782756369.418568:0:14916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 0 00000100:00100000:1.0:1782756369.418618:0:14916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 3 00000100:00100000:1.0:1782756369.418635:0:14916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+17:2357:x1869355210106752:12345-192.168.204.25@tcp:4:dd.0 00010000:00010000:1.0:1782756369.418688:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb37c2ab/0x5e4fb0a8aa19a29d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.418709:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756369.418726:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756369.418735:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb37c2ab/0x5e4fb0a8aa19a29d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.418751:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb37c2ab/0x5e4fb0a8aa19a29d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756369.492025:0:16291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782756369.565658:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:0.0:1782756369.565702:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:0.0:1782756369.565866:0:16406:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:0.0:1782756369.565872:0:16406:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 6151 00010000:00010000:0.0:1782756369.565895:0:16406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dced21c9/0x5e4fb0a8aa19a28f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756369.565909:0:16406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dced21c9/0x5e4fb0a8aa19a28f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756369.565918:0:16406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dced21c9/0x5e4fb0a8aa19a28f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756369.565951:0:16406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41497e00 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:0.0:1782756369.565958:0:16406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dced21c9/0x5e4fb0a8aa19a28f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756369.565970:0:16406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dced21c9/0x5e4fb0a8aa19a28f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756369.565996:0:16406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dced21c9/0x5e4fb0a8aa19a28f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756369.566004:0:16406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dced21c9/0x5e4fb0a8aa19a28f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.568564:0:16407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d173de0e/0x5e4fb0a8aa19a296 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.568593:0:16407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d173de0e/0x5e4fb0a8aa19a296 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.568604:0:16407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d173de0e/0x5e4fb0a8aa19a296 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.568612:0:16407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c41497400 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:1.0:1782756369.568618:0:16407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d173de0e/0x5e4fb0a8aa19a296 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.568629:0:16407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d173de0e/0x5e4fb0a8aa19a296 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.568657:0:16407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d173de0e/0x5e4fb0a8aa19a296 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.568665:0:16407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d173de0e/0x5e4fb0a8aa19a296 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756369.569273:0:16407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77040e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+14:2357:x1869355210106624:12345-192.168.204.25@tcp:4:dd.0 Request processed in 286823us (290408us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1782756369.569288:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 2 00000100:00100000:1.0:1782756369.569339:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 4 00000100:00100000:1.0:1782756369.569354:0:16407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+13:2357:x1869355210106880:12345-192.168.204.25@tcp:4:dd.0 00010000:00010000:1.0:1782756369.569413:0:16407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa19a2a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.569433:0:16407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756369.569439:0:16407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756369.569448:0:16407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa19a2a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.569464:0:16407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa19a2a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756369.570011:0:16406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+13:2357:x1869355210106496:12345-192.168.204.25@tcp:4:dd.0 Request processed in 295855us (304853us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1782756369.570026:0:16406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1 00000100:00100000:3.0:1782756369.570053:0:16406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5 00000100:00100000:3.0:1782756369.570066:0:16406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+12:2357:x1869355210107008:12345-192.168.204.25@tcp:4:dd.0 00010000:00010000:3.0:1782756369.570123:0:16406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088299ba3/0x5e4fb0a8aa19a2ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756369.570134:0:16406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756369.570137:0:16406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782756369.570142:0:16406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088299ba3/0x5e4fb0a8aa19a2ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756369.570153:0:16406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088299ba3/0x5e4fb0a8aa19a2ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756369.709177:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756369.709327:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210107520 00000100:00100000:1.0:1782756369.709340:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210107520 00000100:00100000:1.0:1782756369.709425:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18 00000100:00100000:1.0:1782756369.709438:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+20:2355:x1869355210107520:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1782756369.709573:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+20:2355:x1869355210107520:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 137us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756369.709582:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18 00000001:00080000:0.0:1782756369.712886:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:1.0:1782756369.713279:0:14916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:1.0:1782756369.713309:0:14916:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1782756369.713334:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb37c2ab/0x5e4fb0a8aa19a29d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.713350:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb37c2ab/0x5e4fb0a8aa19a29d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.713360:0:14916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb37c2ab/0x5e4fb0a8aa19a29d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.713367:0:14916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4400 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:1.0:1782756369.713373:0:14916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb37c2ab/0x5e4fb0a8aa19a29d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.713383:0:14916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb37c2ab/0x5e4fb0a8aa19a29d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.713483:0:14916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb37c2ab/0x5e4fb0a8aa19a29d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.713608:0:14916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb37c2ab/0x5e4fb0a8aa19a29d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756369.713781:0:14916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+15:2357:x1869355210106752:12345-192.168.204.25@tcp:4:dd.0 Request processed in 295146us (434832us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1782756369.713793:0:14916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 3 00000100:00100000:1.0:1782756369.713837:0:14916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6 00000100:00100000:1.0:1782756369.713860:0:14916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+14:2357:x1869355210107136:12345-192.168.204.25@tcp:4:dd.0 00010000:00010000:1.0:1782756369.713906:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b9cfd33/0x5e4fb0a8aa19a2b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.713921:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756369.713925:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782756369.713934:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b9cfd33/0x5e4fb0a8aa19a2b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756369.713948:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b9cfd33/0x5e4fb0a8aa19a2b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756369.747431:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756369.747483:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756369.747530:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756369.747557:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756369.747584:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756369.747626:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1782756369.747672:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210107392 00000100:00100000:1.0:1782756369.747685:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210107392 00000100:00100000:1.0:1782756369.747874:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 118 00000100:00100000:1.0:1782756369.747887:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c795c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a70182dd-4d00-4e89-9377-2e7b41557e6b+13:2356:x1869355210107392:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1782756369.747987:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c795c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a70182dd-4d00-4e89-9377-2e7b41557e6b+13:2356:x1869355210107392:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 102us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756369.747996:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 118 00000100:00100000:1.0:1782756369.748036:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210107648 00000100:00100000:1.0:1782756369.748049:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210107648 00000100:00100000:1.0:1782756369.748104:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210108160 00000100:00100000:1.0:1782756369.748107:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210108160 00000100:00100000:1.0:1782756369.748122:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210107776 00000100:00100000:1.0:1782756369.748124:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210107776 00000100:00100000:1.0:1782756369.748133:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210108032 00000100:00100000:1.0:1782756369.748135:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210108032 00000100:00100000:1.0:1782756369.748148:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9 00000100:00100000:1.0:1782756369.748154:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+5:2356:x1869355210107648:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1782756369.748184:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+5:2356:x1869355210107648:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 30us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756369.748190:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9 00000100:00100000:3.0:1782756369.748784:0:14911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 10 00000100:00100000:3.0:1782756369.748812:0:14911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b674de3-88f4-4444-b144-96e2e5cb396a+5:2356:x1869355210108160:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756369.748858:0:14911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b674de3-88f4-4444-b144-96e2e5cb396a+5:2356:x1869355210108160:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 52us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756369.748865:0:14911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 10 00000100:00100000:2.0:1782756369.749694:0:16051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 11 00000100:00100000:2.0:1782756369.749710:0:16051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+16:2355:x1869355210107776:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:2.0:1782756369.749758:0:16051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+16:2355:x1869355210107776:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 54us (2174us total) trans 0 rc 0/0 00000100:00100000:2.0:1782756369.749765:0:16051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 11 00000100:00100000:1.0:1782756369.749924:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 12 00000100:00100000:1.0:1782756369.749936:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b674de3-88f4-4444-b144-96e2e5cb396a+5:2355:x1869355210108032:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1782756369.749968:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b674de3-88f4-4444-b144-96e2e5cb396a+5:2355:x1869355210108032:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 37us (2343us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756369.749975:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 12 00000100:00100000:3.0:1782756369.757720:0:15590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210107904 00000100:00100000:3.0:1782756369.758030:0:15590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210107904 00000100:00100000:3.0:1782756369.758254:0:15590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19 00000100:00100000:3.0:1782756369.758269:0:15590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b674de3-88f4-4444-b144-96e2e5cb396a+6:2356:x1869355210107904:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756369.758458:0:15590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b674de3-88f4-4444-b144-96e2e5cb396a+6:2356:x1869355210107904:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 192us (10927us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756369.758468:0:15590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19 00000100:00080000:3.0:1782756369.758618:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782756369.758630:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782756369.758636:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1782756369.893846:0:16407:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:0.0:1782756369.893862:0:16407:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:0.0:1782756369.893885:0:16407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa19a2a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756369.893903:0:16407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa19a2a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756369.893913:0:16407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa19a2a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756369.893922:0:16407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef4c00 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:0.0:1782756369.893946:0:16407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa19a2a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756369.893959:0:16407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa19a2a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756369.894004:0:16407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa19a2a4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756369.894013:0:16407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d499bb64/0x5e4fb0a8aa19a2a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782756369.894240:0:16407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+16:2357:x1869355210106880:12345-192.168.204.25@tcp:4:dd.0 Request processed in 324882us (615254us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1782756369.894254:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 4 00000100:00100000:0.0:1782756369.894306:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7 00000100:00100000:0.0:1782756369.894326:0:16407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c77042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+15:2357:x1869355210107264:12345-192.168.204.25@tcp:4:dd.0 00010000:00010000:0.0:1782756369.894373:0:16407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbb489af/0x5e4fb0a8aa19a2b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756369.894389:0:16407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1782756369.894394:0:16407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782756369.894404:0:16407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbb489af/0x5e4fb0a8aa19a2b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782756369.894420:0:16407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbb489af/0x5e4fb0a8aa19a2b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782756369.894924:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:2.0:1782756369.896755:0:16406:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:2.0:1782756369.896783:0:16406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088299ba3/0x5e4fb0a8aa19a2ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756369.896797:0:16406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088299ba3/0x5e4fb0a8aa19a2ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756369.896807:0:16406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088299ba3/0x5e4fb0a8aa19a2ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756369.896814:0:16406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c48257600 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:2.0:1782756369.896821:0:16406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088299ba3/0x5e4fb0a8aa19a2ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756369.896846:0:16406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088299ba3/0x5e4fb0a8aa19a2ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756369.896870:0:16406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088299ba3/0x5e4fb0a8aa19a2ab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782756369.896879:0:16406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088299ba3/0x5e4fb0a8aa19a2ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782756369.896952:0:16406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+11:2357:x1869355210107008:12345-192.168.204.25@tcp:4:dd.0 Request processed in 326885us (617954us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1782756369.896971:0:16406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5 00000001:00080000:0.0:1782756369.982441:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:3.0:1782756369.982605:0:14916:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00010000:00010000:3.0:1782756369.982625:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b9cfd33/0x5e4fb0a8aa19a2b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756369.982637:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b9cfd33/0x5e4fb0a8aa19a2b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756369.982646:0:14916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b9cfd33/0x5e4fb0a8aa19a2b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756369.982654:0:14916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c78ef5200 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:3.0:1782756369.982660:0:14916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b9cfd33/0x5e4fb0a8aa19a2b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756369.982698:0:14916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b9cfd33/0x5e4fb0a8aa19a2b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756369.982721:0:14916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b9cfd33/0x5e4fb0a8aa19a2b2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782756369.982736:0:14916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b9cfd33/0x5e4fb0a8aa19a2b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782756369.982851:0:14916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+9:2357:x1869355210107136:12345-192.168.204.25@tcp:4:dd.0 Request processed in 268992us (703840us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1782756369.982862:0:14916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6 00000001:00080000:0.0:1782756370.015161:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:1.0:1782756370.015672:0:16407:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1782756370.015693:0:16407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbb489af/0x5e4fb0a8aa19a2b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756370.015708:0:16407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bbb489af/0x5e4fb0a8aa19a2b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756370.015718:0:16407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bbb489af/0x5e4fb0a8aa19a2b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756370.015746:0:16407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d3c76e17c00 already unused, calling callback (ffffffffc166cce0) 00010000:00010000:1.0:1782756370.015753:0:16407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbb489af/0x5e4fb0a8aa19a2b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756370.015764:0:16407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbb489af/0x5e4fb0a8aa19a2b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756370.015788:0:16407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bbb489af/0x5e4fb0a8aa19a2b9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782756370.015796:0:16407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbb489af/0x5e4fb0a8aa19a2b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782756370.015977:0:16407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c77042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+5:2357:x1869355210107264:12345-192.168.204.25@tcp:4:dd.0 Request processed in 121651us (736937us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1782756370.015988:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7 00010000:00010000:2.0:1782756370.508335:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756371.404771:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c77040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222663680:0@lo:400:kworker.0 00000100:00100000:1.0:1782756371.404805:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c77041f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c7873c7-f262-4959-b911-d0a7cf42af86:3317:1869355222663424:0@lo:400:kworker.0 00000100:00100000:3.0:1782756371.404822:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c77040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869355222663808:0@lo:400:kworker.0 00000100:00100000:2.0:1782756371.405020:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c77042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222663552:0@lo:400:kworker.0 00000100:00100000:3.0:1782756371.405150:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756371.405157:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756371.405294:0:14911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222663680 00000100:00100000:0.0:1782756371.405302:0:14911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222663680 00000100:00080000:3.0:1782756371.405350:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782756371.405428:0:14911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782756371.405441:0:14911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222663680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782756371.405542:0:14911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222663680:12345-0@lo:400:kworker.0 Request processed in 79us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756371.405562:0:14911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782756371.405599:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78e11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222664192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782756371.405688:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782756371.405744:0:3315:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1782756371.405751:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d3c6a33d180, transno 8589934595 00000004:00080000:0.0:1782756371.405774:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1782756371.405820:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c77040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222663680:0@lo:400:kworker.0 00000100:00100000:0.0:1782756371.405982:0:14914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222664192 00000100:00100000:0.0:1782756371.405987:0:14914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222664192 00000100:00100000:0.0:1782756371.406022:0:14914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782756371.406029:0:14914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222664192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782756371.406059:0:14914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1782756371.406702:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756371.406734:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78f85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869355222663936:0@lo:400:kworker.0 00000100:00100000:1.0:1782756371.406763:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756371.406800:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222663808 00000100:00100000:1.0:1782756371.406804:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222663808 00000100:00100000:1.0:1782756371.406834:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222663936 00000100:00100000:1.0:1782756371.406838:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222663936 00000100:00100000:1.0:1782756371.406869:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782756371.406950:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869355222663808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756371.406999:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869355222663808:12345-0@lo:400:kworker.0 Request processed in 52us (1849us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756371.407007:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782756371.407025:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782756371.407032:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c7fb9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869355222663936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756371.407070:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c7fb9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869355222663936:12345-0@lo:400:kworker.0 Request processed in 39us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756371.407096:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782756371.407117:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222663424 00000100:00100000:1.0:1782756371.407120:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222663424 00000100:00100000:1.0:1782756371.407151:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1782756371.407159:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c795c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+19:3317:x1869355222663424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782756371.407203:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c795c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c7873c7-f262-4959-b911-d0a7cf42af86+19:3317:x1869355222663424:12345-0@lo:400:kworker.0 Request processed in 45us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756371.407210:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1782756371.407250:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782756371.407277:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c77040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869355222663808:0@lo:400:kworker.0 00000100:00100000:1.0:1782756371.407305:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c77041f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c7873c7-f262-4959-b911-d0a7cf42af86:3317:1869355222663424:0@lo:400:kworker.0 00000100:00100000:1.0:1782756371.407316:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78f85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869355222663936:0@lo:400:kworker.0 00000100:00100000:0.0:1782756371.407642:0:14914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869355222664192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1611us (1975us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756371.407662:0:14914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782756371.407678:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756371.407705:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c78f87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869355222664064:0@lo:400:kworker.0 00000100:00100000:2.0:1782756371.407740:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782756371.407775:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222664064 00000100:00100000:2.0:1782756371.407779:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222664064 00000100:00100000:3.0:1782756371.407845:0:16051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222663552 00000100:00100000:3.0:1782756371.407850:0:16051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222663552 00000100:00100000:3.0:1782756371.407887:0:16051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782756371.407896:0:16051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222663552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782756371.407945:0:16051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1869355222663552:12345-0@lo:400:kworker.0 Request processed in 51us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756371.407952:0:16051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1782756371.407974:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782756371.407977:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782756371.407992:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782756371.408002:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c6a33c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869355222664064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782756371.408013:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c77042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869355222663552:0@lo:400:kworker.0 00000100:00100000:2.0:1782756371.408046:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c6a33c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869355222664064:12345-0@lo:400:kworker.0 Request processed in 46us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756371.408049:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78f87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869355222664064:0@lo:400:kworker.0 00000100:00100000:2.0:1782756371.408061:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782756371.408238:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c78e11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869355222664192:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782756371.532960:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782756371.813172:0:16445:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1782756372.571513:0:16291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782756373.581692:0:14260:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782756373.965143:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782756373.965177:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9d3c7fb9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222664320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782756373.965295:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782756373.966246:0:14914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355222664320 00000100:00100000:1.0:1782756373.966259:0:14914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355222664320 00000100:00100000:1.0:1782756373.966346:0:14914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782756373.966358:0:14914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78f86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222664320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782756373.966421:0:14914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782756373.966521:0:14914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78f86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869355222664320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1782756373.966538:0:14914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1782756373.969696:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782756373.973826:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9d3c7fb9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869355222664320:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1782756374.046568:0:14307:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1782756374.046587:0:14307:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782756374.046662:0:14307:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1782756374.046671:0:14307:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:00080000:0.0:1782756374.128852:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934620 is committed 00000020:00080000:0.0:1782756374.128880:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d3c76f31c00 refcount 2 committed 0 result 0 batchid 4294967527 00000020:00080000:0.0:1782756374.128888:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d3b427c7d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d3c76f31e40 00000020:00080000:0.0:1782756374.128891:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d3b427c7500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d3c47095800 00000001:00080000:0.0:1782756374.128953:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:0.0:1782756374.128986:0:14311:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967527 committed batchid 8 00000020:00080000:0.0:1782756374.129361:0:14311:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1782756374.605349:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782756374.860801:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756374.860857:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756374.860903:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756374.860934:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756374.860952:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756374.860970:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756374.861019:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1782756374.861057:0:16051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210108544 00000100:00100000:3.0:1782756374.861068:0:16051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210108544 00000100:00100000:3.0:1782756374.861190:0:16051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210109056 00000100:00100000:3.0:1782756374.861194:0:16051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210109056 00000100:00100000:3.0:1782756374.861210:0:16051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210108672 00000100:00100000:3.0:1782756374.861212:0:16051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210108672 00000100:00100000:3.0:1782756374.861224:0:16051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210108928 00000100:00100000:3.0:1782756374.861227:0:16051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210108928 00000100:00100000:3.0:1782756374.861244:0:16051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 15 00000100:00100000:3.0:1782756374.861254:0:16051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+5:2358:x1869355210108544:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756374.861342:0:16051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+5:2358:x1869355210108544:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 89us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756374.861350:0:16051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 15 00000100:00100000:3.0:1782756374.861368:0:16051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16 00000100:00100000:3.0:1782756374.861374:0:16051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c80fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b674de3-88f4-4444-b144-96e2e5cb396a+5:2358:x1869355210109056:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1782756374.861400:0:16051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c80fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b674de3-88f4-4444-b144-96e2e5cb396a+5:2358:x1869355210109056:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 26us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1782756374.861406:0:16051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16 00000100:00100000:0.0:1782756374.864232:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210108288 00000100:00100000:0.0:1782756374.864251:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210108288 00000100:00100000:0.0:1782756374.864346:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 120 00000100:00100000:0.0:1782756374.864359:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c795c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a70182dd-4d00-4e89-9377-2e7b41557e6b+13:2358:x1869355210108288:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756374.864456:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c795c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a70182dd-4d00-4e89-9377-2e7b41557e6b+13:2358:x1869355210108288:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 100us (3670us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756374.864464:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 120 00000100:00100000:0.0:1782756374.864521:0:14911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17 00000100:00100000:0.0:1782756374.864532:0:14911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+5:2358:x1869355210108672:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756374.864568:0:14911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+5:2358:x1869355210108672:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 39us (3597us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756374.864600:0:14911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17 00000100:00100000:0.0:1782756374.864620:0:14911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18 00000100:00100000:0.0:1782756374.864629:0:14911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b674de3-88f4-4444-b144-96e2e5cb396a+5:2358:x1869355210108928:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756374.864665:0:14911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b674de3-88f4-4444-b144-96e2e5cb396a+5:2358:x1869355210108928:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 39us (3646us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756374.864672:0:14911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18 00000100:00100000:0.0:1782756374.864735:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210108800 00000100:00100000:0.0:1782756374.864740:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210108800 00000100:00100000:0.0:1782756374.864780:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355210108416 00000100:00100000:0.0:1782756374.864785:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355210108416 00000100:00100000:0.0:1782756374.864813:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 23 00000100:00100000:0.0:1782756374.864820:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3c78e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b674de3-88f4-4444-b144-96e2e5cb396a+6:2358:x1869355210108800:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756374.864852:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3c78e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b674de3-88f4-4444-b144-96e2e5cb396a+6:2358:x1869355210108800:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 32us (3949us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756374.864859:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 23 00000100:00100000:0.0:1782756374.864870:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 24 00000100:00100000:0.0:1782756374.864876:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d3b419f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+12:2358:x1869355210108416:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1782756374.864901:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d3b419f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f2479af-f49e-47f8-ab4c-80d5e6645c7e+12:2358:x1869355210108416:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 25us (3947us total) trans 0 rc 0/0 00000100:00100000:0.0:1782756374.864908:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 24 00000100:00080000:2.0:1782756374.868964:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782756374.868980:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782756374.868984:0:14268:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 Debug log: 28518 lines, 28518 kept, 0 dropped, 0 bad.